Information processing device, information processing method, and recording media

ABSTRACT

An electronic camera connected through a communication line to another electronic camera records an image that was transmitted from the other camera. When the electronic camera is connected to a public line from a modular jack, when a shooting lens faces opposite to a surface where an LCD is formed, the image of the user which was input by a CCD is transmitted to the other camera through the public line and is displayed on the LCD of the other camera. Furthermore, the image of the user of the other camera which was input by the other camera is transmitted through the public line and displayed on the LCD of the first camera. At this time, when a release switch to shoot an object is operated, the image which is displayed on the LCD is recorded. Furthermore, when a rotating part containing the shooting part is rotated by either electronic camera, the image which was input by the electronic camera in which the rotating part was rotated is displayed on both electronic cameras. At this time, when the release button is pressed, the image which was input by the electronic camera is which the rotating part was rotated is recorded. Additionally, when information is transferred from the electronic camera to a telephone, facsimile machine, video telephone or a server via the communication line, such as a network, transmission of identifying information for the respective information processing device is received, and the type of information that can be handled by the other party&#39;s information receiving device is evaluated based upon this identifying information. Then, in response to the evaluation results, only the information that can be handled is transmitted to the respective information processing device.

[0001] The disclosure of the following priority applications are hereinincorporated by reference:

[0002] Japanese Patent Application No. 9-240640 filed Sep. 5, 1997;

[0003] Japanese Patent Application No. 9-291982 filed Oct. 24, 1997;

[0004] Japanese Patent Application No. 9-305213 filed Nov. 7, 1997; and

[0005] Japanese Patent Application No. 9-305238 filed Nov. 7, 1997.

BACKGROUND OF THE INVENTION

[0006] 1. Field of Invention

[0007] The present invention relates to an information processingdevice, information processing method, and a recording media, andparticularly, to information processing devices, information processingmethods, and recording media which can communicate information withanother information processing device via a communication line.

[0008] 2. Description of Related Art

[0009] Through advancements in image compression technology, it isbecoming possible to send images such as moving images by using atransmission media, for example, a telephone line, having a relativelysmall transmission capacity.

[0010] For example, in video telephone communication, after thecompression processing is performed for the image which was shot by aCCD or the like based upon a standard such as MPEG (Moving PictureExperts Group), the image is sent to a receiving party through atelephone line. At the receiving side, the information is decompressedand the original image is displayed on an LCD or the like.

SUMMARY OF THE INVENTION

[0011] In an electronic camera, after an image is compressed, it isrecorded to a recording medium such as a memory. However, if, instead ofrecording the image to the recording medium the image is sent to areceiving party side through a public line, it is possible to realize avideo telephone system.

[0012] However, when a video telephone system is realized by using anelectronic camera, there are two information input sources: the operatorand the other side (receiving party). Therefore, for example, when therelease button is operated, it is necessary to rule which of the twoinformation sources should be the recording object. However, theconventional electronic camera was not structured to send and receiveinformation by communication, so there was a problem such that, forexample, the image which was sent by the other side cannot be shot.

[0013] The present invention was made to overcome the above problem. Forexample, when the electronic camera is connected through a communicationline and the information such as an image is received, the presentinvention easily records the image which was sent by the other side.

[0014] The present invention also relates to electronic cameras that canhandle not only ordinary image information obtained by imaging anobject, but also line drawing information input by a pen and soundinformation taken in via a microphone. When information is sent andreceived via a communication line between this type of informationprocessing device that can handle a plurality of information and anotherinformation processing device, depending on the capabilities of theinformation processing devices of the communicating parties, there arecases in which only specified ones of the plurality of information canbe handled.

[0015] Normally, a user cannot know what types of information the otherinformation processing device can handle. Therefore, in these cases, itis necessary for the user to find out in advance, for example bytelephone, what types of information the other party's informationprocessing device can handle, and then to set the various modes matchingthe information processing device. Therefore, the operations involvedbecome complex, which is inconvenient.

[0016] The present invention overcomes such problems and simply andreliably enables communication of specified information among aplurality of information with another information processing device.

[0017] When the video telephone system is realized by using a portableinformation processing device, as described earlier, a display devicewhich is installed in this type of device is small so that there is aproblem that resolution of each image deteriorates when a plurality ofimages are simultaneously displayed, and the images cannot be easilyseen as a result.

[0018] It has been considered that a plurality of these images could beappropriately selected and displayed, but there was a problem such thatconventionally, an appropriate selection method was not proposed.

[0019] The present invention renders it possible to appropriately selecta plurality of images and display them on a display device when a videotelephone system with a small display device, for example, a portableinformation processing device, is used.

BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The invention is described in detail with reference to thefollowing figures wherein like reference numerals designate similaritems, and wherein:

[0021]FIG. 1 is a front perspective view of an electronic cameraaccording to one embodiment of the present invention;

[0022]FIG. 2 is a rear perspective view of the electronic camera asshown in FIG. 1;

[0023]FIG. 3 is a rear perspective view of the electronic camera withits LCD cover closed;

[0024]FIG. 4 is a rear perspective view showing some of the insidecomponents of the electronic camera as shown in FIGS. 1 and 2;

[0025]FIG. 5 is a diagram explaining the relationship between theposition of the LCD cover and the state of a power switch and an LCDswitch;

[0026]FIG. 6 is a block diagram showing the electrical structure of theinternal part of the electronic camera shown in FIGS. 1 and 2;

[0027]FIG. 7 is a diagram explaining the processing of thinning out thepixels during the L mode;

[0028]FIG. 8 is a diagram explaining the processing of thinning out thepixels during the H mode;

[0029]FIG. 9 is a diagram showing an example of the display screen ofthe electronic camera shown in FIGS. 1 and 2;

[0030]FIG. 10 is a diagram showing the connecting relationship when theelectronic camera is connected through a public line as shown in FIG. 1;

[0031]FIG. 11 is a diagram showing one example of the format of theinformation which is mutually transmitted between electronic camerasthrough the public line as shown in FIG. 10;

[0032]FIG. 12 is a flow chart explaining one example of the processingwhich is executed in the electronic camera as shown in FIG. 10;

[0033]FIG. 13 is a display example of the screen which is displayed onthe LCD in step S4 as shown in FIG. 12;

[0034]FIG. 14 is a diagram showing a display example of an image whichis displayed on the electronic camera by the processing which is shownin FIG. 12;

[0035]FIG. 15 is a diagram showing a display example of the image whichis displayed on the electronic camera by the processing which is shownin FIG. 12;

[0036]FIG. 16 is a flow chart explaining the processing which is shownin step S9 of FIG. 12 in detail;

[0037]FIG. 17 is a diagram showing a display example of the image whichis displayed when the pen input is performed;

[0038]FIG. 18 is a flow chart explaining the detailed processing whichis shown in step S12 of FIG. 12;

[0039]FIG. 19 is a flow chart explaining one example of the processingwhich is executed in the electronic camera as shown in FIG. 10;

[0040]FIG. 20 is a drawing showing connection of the electronic camerashown in FIG. 1 via a network to various information processing devices;

[0041]FIG. 21 is a block diagram showing an example of the compositionof a server;

[0042]FIG. 22 is a drawing that describes the format of signalstransmitted from the electronic camera of FIG. 20;

[0043]FIG. 23 is a flow chart that describes the processing of theelectronic camera of FIG. 20;

[0044]FIG. 24 is a flow chart that describes the processing of theelectronic camera of FIG. 20;

[0045]FIG. 25 is a flow chart that describes the processing of theelectronic camera of FIG. 20;

[0046]FIG. 26 is a flow chart that describes the processing of theelectronic camera of FIG. 20;

[0047]FIG. 27 is a drawing that shows an example of the display in stepS116 of FIG. 23;

[0048]FIG. 28 is a drawing that shows an example of the display in stepS117 of FIG. 23;

[0049]FIG. 29 is a drawing that shows an example of the display in stepS118 of FIG. 23;

[0050]FIG. 30 is a drawing that shows an example of the display in stepS 133 of FIG. 23;

[0051]FIG. 31 is a drawing that shows an example of the display of themenu in step S135 of FIG. 24;

[0052]FIG. 32 is a diagram that shows the electronic camera of FIG. 1connected via a network to other devices;

[0053]FIG. 33 is a diagram that shows the electronic camera of FIG. 1connected via a network to still other devices;

[0054]FIG. 34 is a flow chart explaining the processing which is shownin step S9 of FIG. 12;

[0055]FIG. 35 is a flow chart explaining the processing which is shownin steps S49 and S41 of FIG. 34;

[0056]FIG. 36 is a drawing that shows an example of a menu display instep S211 of FIG. 34;

[0057]FIG. 37 is a drawing that shows an example of a memo display;

[0058]FIG. 38 is a flow chart explaining the processing which is shownin step S12 of FIG. 12; and

[0059]FIG. 39 is a flow chart explaining the processing which is shownin steps S68 and S74 of FIG. 38.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

[0060] The following explains the embodiments of the present inventionby referring to the drawings.

[0061]FIGS. 1 and 2 are perspective front views of an electronic cameraaccording to an embodiment of the present invention. In the electroniccamera of the present embodiment, the surface facing toward an objectwhen the object is shot is defined as surface X1, and the surface facingtoward the user is defined as surface X2. At the top portion of thesurface X1, a rotating part 19 is arranged on which a finder 2, ashooting lens 3, a light emitting part 4, a red eye reduction lamp 15, aphotometric element 16, and a colorimetric element 17 are disposed. Therotating part 19 is rotatable. Thus, it is possible to rotate thesurface where the shooting lens 3 is disposed from the direction of thesurface X1 to the direction of the surface X2, and to fix it in anarbitrary position therebetween. Furthermore, the finder 2 is used toconfirm an object shooting area, the shooting lens 3 takes in the lightimage of the object, and the light emitting part (strobe) 4 emits lightthat illuminates the object.

[0062] When shooting is performed by causing the emitting the strobe 4to emit light, before the strobe 4 emits light, the red eye reductionlamp 15 reduces the red eye phenomenon. The photometric element 16performs photometry when the operation of a CCD 20 (FIG. 4: imageinputting device) is stopped. Likewise, the colorimetric element 17performs colorimetry when the operation of CCD 20 is stopped.

[0063] Meanwhile, in a rear surface (opposite shooting lens), a speaker5, which outputs sound recorded in the electronic camera 1, and an eyepiece of finder 2 are arranged. In addition, an LCD 6 and an operatingkey 7 formed on the surface X2 are provided below the finder 2, theshooting lens 3, the emitting part 4, and the speaker 5. A touch tablet6A is provided on the surface of LCD 6. The touch tablet 6A, by acontacting operation of a pen type indicating device which will bedescribed later, outputs position data corresponding to the position ofthe pen.

[0064] The touch tablet 6A is structured by transparent materials suchas glass and resin. The user can observe the image, which is displayedon LCD 6 which is formed behind the touch tablet 6A, through the touchtablet 6A.

[0065] The operating keys 7 are keys that are operated when recordingdata is reproduced and is displayed on LCD 6. Operating keys 7 detectthe operations (inputting) by the user and provide input to CPU 39 (FIG.6: detection device).

[0066] A menu key 7A among the operating keys 7 is a key which isoperated when a menu screen is to be displayed on LCD 6. An executingkey 7B (operating mechanism) is a key that is operated when the recordedinformation which is selected by the user is to be reproduced.

[0067] A clear key 7C is a key that is operated when the recordedinformation is deleted. A cancel key 7D is a key that is operated whenthe reproducing processing of the recorded information is interrupted. Ascroll key 7E is a key that is operated when the screen is scrolled inthe upper and lower directions when the list of the recorded informationis displayed on LCD 6.

[0068] On the surface X2 is disposed an LCD cover 14, which protects LCD6 when it is not used and which is slidable. As shown in FIG. 3, whenthe LCD cover 14 is moved in the vertically upward direction, the LCD 6and the touch tablet 6A are covered. Furthermore, when the LCD cover 14is moved in the vertically downward direction, the LCD 6 and the touchtablet 6A appear, and a power switch 11 arranged in surface Y2 can beswitched to the “ON” state by an arm part 14A of the LCD cover 14.

[0069] On the top surface of the electronic camera 1, an earphone jack 9is disposed that is connected to a microphone 8, which collects sound,and an undepicted earphone.

[0070] A left surface Y1 includes a release switch 10 (operating means)operated when an object is shot, a continuous mode changing switch 13 isoperated when a continuous mode is changed during shooting, and amodular jack 18 used to connect to a telephone line. The release switch10, the continuous mode changing switch 13 and the modular jack 18 arearranged vertically lower than the finder 2, the shooting lens 3, andthe light emitting part 4, which are arranged on the rotating part 19.

[0071] Meanwhile, in the right surface Y2 opposite the left surface Y1,a recording switch 12 operated when sound is recorded and the powerswitch 11 are arranged. The recording switch 12 and the power switch 11are arranged vertically lower than the finder 2, the shooting lens 3,and the light emitting part 4, which are arranged on the rotating part19, just like the release switch 10 and the continuous mode changingswitch 13. Furthermore, the recording switch 12 is formed approximatelyat the same height as the release switch 10 of the surface Y1 and isstructured so as not to give a strange feel to the user, no matter whichhand is used to hold the recording switch 12.

[0072] However, it is acceptable to make the recording switch 12 and therelease switch 10 at different heights so that when one of the switchesis pressed, a side surface of the opposite side can be held by a fingerin order to negate the moment caused by the pressure. By doing so, aswitch will not be pressed by mistake while the switch arranged on theopposite side surface is pressed.

[0073] The continuous mode changing switch 13 is used to set whether theobject will be shot for one frame or a specified plurality of frameswhen the user shoots an object by pressing the release switch 10. Forexample, when the pointer of the continuous mode changing switch 13 isswitched to the “S” position (S mode), shooting is performed only forone frame when the release switch 10 is pressed.

[0074] Further, when the pointer of the continuous mode changing switch13 is switched to the “L” position (L mode) eight frames of shooting areperformed every second (a low speed continuous mode) during the timewhen the release switch 10 is pressed.

[0075] Moreover, when the pointer of the continuous mode changing switch13 is hanged to the “H” position (H mode), 30 frames of shooting areperformed every second (high speed continuous mode) during the time whenthe release switch 10 is pressed.

[0076] Next, the internal structure of the electronic camera 1 isexplained. FIG. 4 is a perspective figure showing a structural exampleof the internal part of the electronic camera shown in FIGS. 1 and 2.CCD 20 is disposed in the rear step (surface X2 side) of the shootinglens 3, and photoelectrically converts the light image of the objectwhich is shot through the shooting lens 3 to an electric signal.

[0077] The inside finder display element 26 is arranged in the visualfield of the finder 2. For the user who is watching the object throughthe finder 2, the setting state of various functions or the like can bedisplayed. In addition, the finder 2, the shooting lens 3, the lightemitting part 4, the speaker 5, CCD 20, and the inside finder lightemitting element 26 are disposed inside of the cylindrical rotating part19.

[0078] At the vertical lower side of LCD 6, four slender batteries (AAAdry cells) 21 are vertically arrayed, and the power which is stored inthe batteries 21 is provided to each part. In addition, at the verticallower side of LCD 6, along with the batteries 21, a condensor 22 isarranged in which the charge to emit the light to the emitting part 4 isstored.

[0079] On the circuit substrate 23, various control circuits whichcontrol each part of the electronic camera 1 are formed. Furthermore,between the circuit substrate 23 and LCD 6 and batteries 21, aninsertable/retractable memory card 24 (recording means) is disposed, andvarious information to be input to the electronic camera 1 isrespectively recorded to areas of the memory card 24 which are set inadvance.

[0080] An LCD switch 25 disposed adjacent to the power switch 11 isplaced in the “ON” state only during the time when the protruding partthereof is pressed. When the LCD cover 14 is moved in a verticallydownward direction by the arm part 14A of the LCD cover 14, as shown inFIG. 5(a), LCD Switch 25 can be changed to the “ON” state along with thepower switch 11.

[0081] Furthermore, when LCD cover 14 is positioned in the upperposition, the power switch 11 is operated by the user independent of theLCD switch 25. For example, when the LCD cover 14 is closed and theelectronic camera 1 is not used, as shown in FIG. 5(b), the power switch11 and the LCD switch 25 are in the “OFF” state. In this state, as shownin FIG. 5(c), when the user switches the power switch 11 to the “ON”state, the power switch 11 is placed in the “ON” state, but the LCDswitch 25 still remains in the “OFF” state. Meanwhile, as shown in FIG.5(b), when the power switch 11 and the LCD switch 25 are in the “OFF”state, if the LCD cover 14 opens, as shown in FIG. 5(a), the powerswitch 11 and the LCD switch 25 are placed in the “ON” state. Moreover,after this, when the LCD cover 14 is closed, as shown in FIG. 5(c), onlythe LCD switch 25 is placed in the “OFF” state.

[0082] Furthermore, as shown in FIG. 5, the rotating part 19 can be setat an arbitrary angle between the subnormal direction of the surface X1and the subnormal direction of the surface X2.

[0083] In the present embodiment, the memory card 24 can be inserted,but it is also acceptable to provide a memory on the circuit substrate23 and record various information to the memory. In addition, it is alsoacceptable to output various information which is recorded in the memory(memory card 24) to an external personal computer through an interface,which is not depicted.

[0084] Next, the electrical structure of the internal part of theelectronic camera 1 of the present embodiment is explained by referringto the block diagram of FIG. 6. In CCD 20, which has a plurality ofpixels, the light image which is formed on each pixel isphotoelectrically converted to an image signal (electrical signal). Adigital signal processor (hereafter referred as to DSP) 33 (recordingmeans) supplies a CCD horizontal driving pulse to CCD 20, controls theCCD driving circuit 34, and supplies a CCD vertical driving pulse to theCCD 20.

[0085] An image processor 31 is controlled by CPU 39. The image signalwhich is photoelectrically converted by CCD 20 is sampled at a certaintiming, and the sampled signal is amplified to a specified level.Analog/digital (A/D) converting circuit 32 digitizes the image signal,which was sampled by the image processor 31, and supplies it to the DSP33.

[0086] DSP 33 controls a data bus which is connected to the buffermemory 36 and the memory card 24. After the image data which wassupplied by the A/D converting circuit 32 is temporarily stored in thebuffer memory 36, the image data stored in the buffer memory 36 is read,and the image data is stored on the memory card 24.

[0087] Furthermore, in DSP 33, the image data which was supplied by theA/D converting circuit 32 is stored in a frame memory 35 (outputtingmeans) and is displayed on LCD 6, and the shot image data is read fromthe memory card 24. After decompressing the shot image data, thedecompressed image data is stored in the frame memory 35 and isdisplayed on LCD 6.

[0088] Furthermore, in DSP 33, during the activation of the electroniccamera 1, the CCD 20 is repeatedly operated while adjusting the exposingtime (exposure value) until the exposing level of CCD 20 reaches anappropriate value. At this time, it is also acceptable to calculate aninitial value of the exposing time of CCD 20 in response to a receivedlight level, which was detected by the photometric element 16 when theDSP 33 first operates the photometric circuit 51. By so doing, it ispossible to adjust the exposing time of CCD 20 in a short period oftime.

[0089] Other than the above, the DSP 33 performs the timing managementof data input/output in recording the image to the memory card 24,storing the decompressed image data in the buffer memory 36, and soforth.

[0090] The buffer memory 36 is used to smooth out the difference betweenthe speed of the input/output of data for the memory card 24 and theprocessing speed in CPU 39, DSP 33, and the like.

[0091] The microphone 8 collects sound information, which is supplied tothe A/D and D/A converting circuit 42.

[0092] The A/D and D/A converting circuit 42 converts an analog signalcorresponding to sound, which is detected by the microphone 8, to adigital signal and outputs the digital signal to CPU 39. Circuit 42 alsoconverts sound data supplied by the CPU 39 to an analog signal andoutputs the analog sound signal to the speaker 5.

[0093] The photometric element 16 measures the light amount of theobject and its surroundings, and the measurement result is output to thephotometric circuit 51.

[0094] After the photometric circuit 51 performs a specified processingon the analog signal, which is the photometry result which was suppliedby the photometric element 16, that analog signal is converted to adigital signal and the digital signal is output to the CPU 39.

[0095] The calorimetric element 17 measures the color intensity of theobject and its surroundings and the measurement result is output to thecolorimetric circuit 52.

[0096] After the calorimetric circuit 52 performs a specified processingto the analog signal, which is the photometry result which was suppliedby the calorimetric element 17, it is converted to a digital signal andthe digital signal is output to the CPU 39.

[0097] A timer 45 houses a clock circuit, and data corresponding to thecurrent time is output to CPU 39.

[0098] A stop driver 53 sets the opening diameter of an aperture stop 54at a specified value.

[0099] The aperture stop is disposed between the shooting lens 3 and theCCD 20 and changes the opening of the light incident from the shootinglens 3 to the CCD 20.

[0100] A rotating part position detecting circuit 55 receives outputfrom a potentiometer 56, which is moved simultaneously with the rotatingpart 19, to detect the direction where the rotating part 19 faces atthat time.

[0101] When a modem 57 (sending means, receiving means) receives andsends information between other electronic camera 1 connected through apublic line, conversion of the data format is performed.

[0102] In response to the signal from the LCD switch 25, the CPU 39stops the operation of the photometric circuit 51 and colorimetriccircuit 52 when the LCD cover 14 is opened. When the LCD cover 14 isclosed, it begins the operation of the photometric circuit 51 and thecalorimetric circuit 52. Additionally, it stops the operation (e.g.,electronic shutter operation) of the CCD 20 until the release switch 10is placed in a half-pressed state.

[0103] When the CPU 39 stops the operation of the CCD 20, it controlsthe photometric circuit 51 and the calorimetric circuit 52 to receivethe photometry result of the photometric element 16, and the colorimetryresult of the calorimetric element 17.

[0104] Also, by referring to a specified table, the CPU 39 calculatesthe white balance adjusting value corresponding to the color intensitywhich was supplied by the colorimetric circuit 52, and the white balanceadjusting value is supplied to the image processor 31.

[0105] That is, when the LCD cover 14 is closed, the LCD 6 is not usedas an electronic viewfinder, so the operation of the CCD 20 is stopped.Because the CCD 20 consumes much power, it is possible to save power ofthe battery 21 by thus stopping the operation of the CCD 20.

[0106] Furthermore, when the LCD cover 14 is closed, the CPU 39 controlsthe image processor 31 so that the image processor 31 does not performvarious processing until the release switch 10 is operated (until therelease switch 10 in placed in a half-pressed state).

[0107] Moreover, when LCD cover 14 is closed, the CPU 39 controls a stopdriver 53 so that the stop driver 53 does not perform an operation tochange the opening diameter of the stop 54 or the like until the releaseswitch 10 is operated (until the release switch 10 is placed in ahalf-depressed state).

[0108] The CPU 39 controls a strobe drive 37, and the strobe 4appropriately emits light. In addition, a red eye reduction LED (lightemitting diode) driver 38 is controlled, and the red eye reduction lamp15 appropriately emits light prior to the light emission of the strobe4.

[0109] Furthermore, when the LCD cover 14 is opened (that is, theelectronic viewfinder is used), the CPU 39 does not cause the strobe 4to emit light. By so doing, an object can be shot in the form of animage which is displayed in the electronic viewfinder.

[0110] According to the date and time data which is supplied by thetimer 45, the CPU 39 records the shot date and time information to theshot image recording area of the memory card 24 as header information ofthe image data.

[0111] Furthermore, the CPU 39 compresses the sound information that wasdigitized and records it to a specified sound recording area of thememory card 24 after temporarily storing it in the buffer memory 36.Moreover, at this time, in the sound recording area of the memory card24, the recording date and time data is recorded as header informationof the sound data.

[0112] The CPU 39 controls the lens driver 30, moves the shooting lens3, and performs an autofocus operation. In addition, it controls thestop driver 53 and changes the opening diameter of the stop 54 disposedbetween the shooting lens 3 and the CCD 20.

[0113] Furthermore, the CPU 39 controls an in-viewfinder display circuit40, and the settings in various operations or the like are displayed onthe in-viewfinder display element 26.

[0114] The CPU 39 sends/receives data through an interface (I/F) 48to/from a specified external device (undepicted).

[0115] Moreover, the CPU 39 receives signals from the operating keys 7and appropriately performs the processing.

[0116] When a specified position of the touch tablet 6A is pressed by apen type indicating member 41 operated by the user, the CPU 39 reads theX-Y coordinates of the position that was pressed on the touch tablet 6A,and the coordinate data (line drawing information which will bediscussed later) is stored in the buffer memory 36. Furthermore, the CPU39 records the line drawing information stored in the buffer memory 36in the line drawing information recording area of the memory card 24along with the date and time header information of the line drawinginformation.

[0117] Next, various operations of the electronic camera 1 of thepresent embodiment are explained. First of all, the electronicviewfinder operation in the LCD 6 of the present device is explained.

[0118] The DSP 33 is supplied a signal by the CPU 39 when the usercreates a half-pressed state of the release switch 10. It determineswhether the LCD cover 14 is open by the value of the signalcorresponding to the state of the LCD switch 25. When it is determinedthat the LCD cover 14 is closed, the electronic viewfinder operation isnot performed. In this case, the DSP 33 stops processing until therelease switch 10 is operated

[0119] Moreover, when the LCD cover 14 is closed, the electronicviewfinder operation is not to be performed, so the CPU 39 stops theoperations of the CCD 20, the image processor 31, and the stop driver53. Also, instead of operating the CCD 20, the CPU 39 operates thephotometric circuit 51 and calorimetric circuit 52, and the measurementresult is supplied to the image processor 31. The image processor 31uses the value of the measurement result when performing white balancecontrol and the control of the brightness value.

[0120] Furthermore, when the release switch 10 is operated, the CPU 39causes the CCD 20 and the stop driver 53 to operate

[0121] Meanwhile, when the LCD cover 14 is opened, the CCD 20 performsthe electronic shutter operation in a specified exposing time each timea specified time elapses, photoelectrically converts the light image ofthe object which was collected by the shooting lens 3, and outputs theimage signal which is obtained by the operation to the image processor31.

[0122] After the image processor 31 performs the white balance controland the control of the brightness value and after specified processingis performed on the image signal, the image signal is output to the A/Dconverting circuit 32. Moreover, when the CCD 20 is operated, the imageprocessor 31 uses the adjusted value which is used for the white balancecontrol and the control of the brightness value which were calculated bythe CPU 39 using the output of the CCD 20.

[0123] Also, the A/D converting circuit 32 converts the analog imagesignal to image data which is a digital signal, and the obtained imagedata is output to the DSP 33.

[0124] The DSP 33 outputs the image data to the frame memory 35, and theimage corresponding to the image data is displayed on the LCD 6.

[0125] Thus, in the electronic camera 1, when the LCD cover 14 isopened, the CCD 20 performs the electronic shutter operation at aspecified time interval. Every time this is performed, the signal whichis output by the CCD 20 is converted to image data, the image data isoutput to the frame memory 35, and the image of the object iscontinuously displayed on LCD 6 so that the electronic viewfinderoperation is performed.

[0126] Furthermore, as described above, when the LCD cover 14 is closed,the electronic viewfinder operation is not performed, and by stoppingthe operation of the CCD 20, the image processor 31, and the stop driver53, the consumed power is saved.

[0127] Next, the shooting of an object by the present device isexplained.

[0128] First of all, the case when the continuous mode changing switch13 disposed in the surface Y1 is changed to the S mode (one frame only)is explained. First, by switching the power switch 11 shown in FIG. 1 tothe side at which “ON” is printed, the power is input to the electroniccamera 1. The object is confirmed by the finder 2, and a shootingprocessing of the object begins by pressing the release switch 10disposed in surface Y1.

[0129] Furthermore, when the LCD cover 14 is closed and when the releaseswitch 10 becomes a half-pressed state, the operation of the CCD 20, theimage processor 31, and the stop driver 53 begin again by CPU 39. Whenthe release switch 10 becomes a full-pressed state, the shootingprocessing of the object begins.

[0130] The light image of the object which is observed by the finder 2is collected by the shooting lens 3 and is image-formed on the CCD 20with the plurality of pixels. The light image of the object which isimaged-formed on the CCD 20 is photoelectrically converted to an imagesignal in each pixel and is sampled by the image processor 31. The imagesignals which are sampled by the image processor 31 are supplied to theA/D converting circuit 32, digitized, and output to the DSP 33.

[0131] The DSP 33 temporarily outputs the image data to the buffermemory 36, then reads out the image data from the buffer memory 36 andcompresses it according to the JPEG (Joint Photographic Experts Group)method, which combines dispersed cosine conversion, quantization, andHoffman encoding, and records it to the shot image recording area of thememory card 24. At this time, the shooting time and date data isrecorded to the shot image recording area of the memory card 24 as theheader information of the shot image data.

[0132] Furthermore, when the continuous mode changing switch 13 ischanged to the S mode, the shooting of only one frame is performed, andno shooting after this is performed even if the release switch 10 iscontinuously pressed. Moreover, when the release switch 10 iscontinuously pressed, if the LCD cover 14 is open, the image which wasshot is displayed on LCD 6.

[0133] Secondly, the case when the continuous mode changing switch 13 ischanged to the L mode (eight frames every second) is explained. When thepower is input to the electronic camera 1 by changing the power switch11 to the side where “ON” is printed and the release switch 10 disposedin the surface Y1 is pressed, the shooting processing of the objectbegins.

[0134] Furthermore, when the LCD cover 14 is closed, the CPU 39 restartsthe operation of the CCD 20, the image processor 31 and the stop driver53 when the release switch 10 is placed in a half-pressed state, and theshooting processing of the object begins when the release switch 10 isplaced in a full-pressed state.

[0135] The light image of the object which is observed by the finder 2is collected by the shooting lens 2 and is image-formed on the CCD 20with the plurality of pixels. The light image of the object which isimage-formed on the CCD 20 is photoelectrically converted into an imagesignal in each pixel and is sampled at the ratio of eight times everysecond by the image processor 31. Moreover, at this time, the imageprocessor 31 thins out ¾ of the pixels among the image electric signalof all the pixels of the CCD 20.

[0136] That is, as shown in FIG. 7, the image processor 31 divides theimage of the CCD 20 which is arrayed in a matrix of areas each having2×2 pixels (four pixels), samples the image signal of one pixel arrangedin a specified position in one area, and thins out the remaining threepixels.

[0137] For example, during the first sampling (first frame), the pixel aat the upper left of each area is sampled and the other pixels b, c, dare thinned out. During the second sampling (second frame), the pixel bat the upper right of each area is sampled and the other pixels a, c, dare thinned out. Hereafter, during the third and fourth sampling, thepixel c at the lower left and the pixel d at the lower right aresampled, respectively, and the other pixels are thinned out. That is,each pixel is sampled every four frames.

[0138] The image signals (the image signals of ¼ of all the pixels ofthe CCD 20) which were sampled by the image processor 31 are supplied tothe AID converting circuit 32, are digitized there, and are output tothe DSP 33.

[0139] The DSP 33 temporarily outputs the digitized signals to thebuffer memory 36, then reads out the image signals, compresses themaccording to the JPEG method, and records the digitized, compressed shotimage data to the shot image recording area of the memory card 24. Atthis time, the shooting time and date data is recorded to the shot imagerecording area of the memory card 24 as the header information of theshot image data.

[0140] Third, the case when the continuous mode changing switch 13 ischanged to the H mode (30 frames every second) is explained. By changingthe power switch 11 to the side where “ON” is printed, the power isinput to the electronic camera 1, the release switch 10 is disposed insurface Y1 is pressed, so the process of shooting the object begins.

[0141] In addition, when the LCD cover 14 is closed, the CPU 39 restartsthe operation of CCD 20, the image processor 31, and the stop driver 53when the release switch 10 is placed in a half-pressed state and theprocessing of shooting the object begins when the release switch 10 isplaced in a full-pressed state.

[0142] The light image of the object which is observed by the finder 2is collected by the shooting lens 3 and is image-formed on the CCD 20.The light image of the object which is image-formed on the CCD 20, whichhas a plurality of pixels, is photoelectrically converted into an imagesignal in each pixel and is sampled at the rate of 30 times every onesecond by the image processor 31. In addition, at this time, the imageprocessor 31 thins out {fraction (8/9)} of the pixels among the imageelectrical signals of all the pixels of the CCD 20.

[0143] That is, the image processor 31 divides the pixels of the CCD 20,which are arrayed in a matrix into areas of 3×3 pixels, as shown in FIG.8. The image electrical signal of one pixel which is disposed in aspecified position from the area as sampled at the rate of 30 times persecond, and the remaining eight pixels are thinned out.

[0144] For example, during the first sample (first frame), the pixel atthe upper left of each area is sampled, and the other pixels b, c, d . .. i are thinned out. During the second sampling (second frame), thepixel b at the right of pixel a is sampled, and the other pixels a, c, d. . . i are thinned out. Hereafter, during the third and fourthsampling, the pixel c and pixel d are sampled, respectively, and theother pixels are thinned out. That is, each pixel is sampled every nineframes.

[0145] The image signals which were sampled by the image processor 31(the image signal of {fraction (1/9)} of all the pixels of the CCD 20)are supplied to the A/D converting circuit 32, are digitized there, andare output to the DSP 33.

[0146] After the image signals which were digitized are temporarilyoutput to the buffer memory 36, DSP 33 reads the image signal. Aftercompression is performed according to the JPEG method, the headerinformation of the shooting date and time is added to the shot imagedata which was digitized and compressed, and is recorded to the shotimage recording area of the memory card 24.

[0147] It is also possible to irradiate light to the object by operatingthe strobe 4 as needed. However, if the LCD cover 14 is opened, that is,when the LCD 6 performs the electronic viewfinder operation, the CPU 39is controlled so as not to emit light.

[0148] Next, the operation to input two-dimensional information (peninputting information) from the touch tablet 6A is explained.

[0149] When the touch tablet 6A is pressed by the tip of the pen 41, theX-Y coordinates of the place that was contacted are input to the CPU 39.These X-Y coordinates are recorded to the buffer memory 36. Furthermore,the data is written into the part of the frame memory 35 correspondingto each point of the above-mentioned X-Y coordinates, and a line drawingcorresponding to the contact of the pen 41 can be displayed on LCD 6 atthe above-mentioned X-Y coordinates.

[0150] As described above, the touch tablet 6A is structured by atransparent member, so it is possible for the user to observe the point(the point at the position which was pressed by the tip of the pen 41)which is displayed on LCD 6, and he/she feels as if a direct peninputting were being performed on LCD 6. In addition, when the pen 41 ismoved on the touch tablet 6A, a line is displayed on LCD 6 in responseto the movement of the pen 41. Furthermore, when the pen 41 isintermittently moved on the touch tablet 6A, a dotted line is displayedon LCD 6 in response to the movement of the pen 41. Thus, the user caninput desired drawing information such as characters and figures to thetouch tablet 6A (LCD 6).

[0151] Furthermore, when the shot image is displayed on LCD 6, if linedrawing information is input by the pen 41, the drawing information iscombined with the shot image information by the frame memory 35 and issimultaneously displayed on LCD 6.

[0152] In addition, by operating a color selecting switch, which isundepicted, it is possible to select the color of drawing which isdisplayed on LCD 6, from among black, white, red, blue, or the like.

[0153] After inputting the line drawing information to the touch tablet6A by the pen 41, when the executing key 7B or the operation key 7 ispressed, the line drawing information which is stored in the buffermemory 36 is supplied to the memory card 24 along with the input dateand time header information and is recorded to the line drawinginformation recording area of the memory card 24.

[0154] Furthermore, the line drawing information which is recorded tothe memory card 24 is information which has been compressed. The linedrawing information which was input to the touch tablet 6A containsinformation with a high spatial frequency component, so it requires moretime for both compression and decompression due to the inefficiency ofcompression if the compression processing is performed by the JPEGmethod, which is used for the compression of the above-mentioned shotimage. In addition, compression by the JPEG method is nonreversible, soit is not appropriate for the compression of line drawing informationwith a small amount of information (when it is displayed on LCD 6 afterdecompression, the dithering and bleeding look obvious due to thefailure of information).

[0155] Therefore, in the present embodiment, the line drawinginformation is compressed, by the run-length method which is used for afacsimile or the like. The run-length method is a method whichcompresses the line drawing information by scanning the drawing screenin the horizontal direction and encoding the length in which theinformation (point) of each color such as black, white, red, and bluecontinues, and the length which non-information (the part without peninputting) continues.

[0156] By using this run-length method, it is possible to compress theline drawing information most desirably and to control the failure ofthe information even when the compressed line drawing information isdecompressed. In addition, the line drawing information cannot becompressed if the information amount is relatively small.

[0157] Furthermore, as described above, when the shot image is displayedon LCD 6, when the pen inputting is performed, the shot image data andthe line drawing information of the pen inputting are combined in theframe memory 35 and the combined image of the shot image and the linedrawing is displayed on LCD 6. Meanwhile, in the memory card 24, theshot image data is recorded onto the shot image recording area and theline drawing information is recorded onto the line drawing informationrecording area Thus, two pieces of information are recorded intodifferent areas, respectively, so that the user can delete one of images(e.g., line drawing) from the combined image and compress each imageinformation by an individual compression method.

[0158] When data is recorded to the sound recording area, the shot imagerecording area, or the line drawing information recording area of thememory card 24, as shown in FIG. 9, a specified display is performed onLCD 6.

[0159] On the display screen LCD 6, shown in FIG. 9, year/month/date(recording date) of the time when the information was recorded (in thiscase, Aug. 25, 1995) is displayed on the lower edge of the screen andthe recording time of the information which was recorded on thatrecording date is displayed on the left side of the screen.

[0160] On the right side of the recording time, a thumbnail image isdisplayed. This thumbnail image is created by thinning out (reducing)bit map data of each image data of the shot image data which wasrecorded in the memory card 24. The information which is displayed isthe information including the shot image information. That is, the shotimage information is included in the information which was recorded(input) into “10:16” and “10:21”, and the image information is notincluded in the information which was recorded in “10:05”, “10:28”,“10:54”, and “13:10”.

[0161] In addition, a “*” shows that a specified memo is recorded asline drawing information.

[0162] On the right side of the display area of the thumbnail image, asound information bar is displayed and a bar (line) corresponding to thelength of the recording time is displayed (when sound information is notinput, it is not displayed).]

[0163] The user selects and designates information to be reproduced bypressing a part of any desired information display line of LCD 6 shownin FIG. 9 with the tip of the pen 41, and the selected information isreproduced as the executing key 7B shown in FIG. 2 is pressed by the tipof the pen 41.

[0164] For example, when the line which is displayed by “10:05” shown inFIG. 9 is pressed by the pen 41, CPU 39 reads the sound datacorresponding to the selected recording time (10:05) from the memorycard 24 and is supplied to the A/D and D/A converting circuit 42 afterthe decompression of the sound data. The A/D and D/A converting circuit42 analogs the sound data which was supplied and reproduces it throughthe speaker 5.

[0165] When the shot image data which was recorded on the memory card 24is reproduced, the user selects the information by pressing a desiredthumbnail image by the tip of the pen 41 and reproduces the selectedinformation by pressing the executing key 7B.

[0166] The CPU 39 instructs the DSP 33 to read the shot image datecorresponding to the selected shot time and date from the memory card24. The DSP 33 decompresses the shot image data (the shot image datawhich is compressed) which was read from the memory card 24, and theshot image data is stored into the frame memory 35 as bit map data andis displayed on LCD 6.

[0167] An image which was shot in the S mode is displayed on LCD 6 as astill image. Needless to say, the still image is an image whichreproduces the image signal of the entire pixels of CCD 20.

[0168] An image which was shot in the L mode is continuously displayedat the rate of eight frames every second on LCD 6. At this time, thenumber of pixels which are displayed for each frame is ¼ of all thepixels of CCD 20.

[0169] Usually, human eyes sensitively respond to the deterioration ofthe resolution of the still image so that the user may think thatthinning out of the pixels of the still image is a deterioration of theimage quality. However, when the speed of the continuous shootingincreases, eight frames are shot every second in the L mode, and whenthese images are reproduced at a speed of eight frames every second, thenumber of pixels of each frame becomes ¼ of the number of pixels of theCCD 20, but the human eye observes the image of 8 frames for one second,so the information amount which enters into human eyes for one secondbecomes double compared to the case of the still image.

[0170] That is, if the number of pixels of one frame of the image whichwas shot by the S mode is defined as 1, the number of pixels of oneframe of the image which was shot in the L mode is ¼. When the image(still image) which was shot in the S mode is displayed on LCD 6, theinformation amount which enters into human eyes in one second is1(=(number of pixels 1)×(number of frames 1)). Meanwhile, when an imagewhich was shot in the L mode is displayed on LCD 6, the informationamount which enters into human eyes for one second is 2(=(number ofpixels ¼)×(number of frames 8)) (that is, twice the information of thestill image enters into human eyes). Therefore, even though the numberof pixels in one frame is ¼, the user can observe the reproduction imageduring the reproduction without noticing much deterioration.

[0171] In addition, in the present embodiment, various pixels for eachframe are sampled and the sampled pixels are displayed on LCD 6, so aresidual image effect occurs in human eyes, and the user can observe theimage which was shot in the L mode on LCD 6 without noticing muchdeterioration, even if ¾ of the pixels are thinned out.

[0172] Moreover, an image which was shot in the H mode is continuouslydisplayed at the rate of 30 frames every second on LCD 6. At this time,the number of pixels which are displayed for each frame is {fraction(1/9)} of all the pixels of CCD, but the user can observe the imagewhich was shot in the H mode on LCD 6 without noticing muchdeterioration due to the same reason as for the L mode.

[0173] In the present embodiment, when an object is shot in the L and Hmodes, the image processor 31 thins out the image of CCD 20 to thedegree where the user does not notice much deterioration of the imagequality during the reproduction, so it is possible to reduce the burdenof the DSP 33 and to operate DSP 33 at low speed and with low power.Furthermore, by so doing, it is possible to reduce the cost of thedevice and save power.

[0174] Incidentally, in the present embodiment, as shown in FIG. 10, twoelectronic cameras 1-A and 1-B are connected through the public line 61and can mutually communicate. Furthermore, hereafter, the operating modein which two electronic cameras are mutually connected through thecommunication line such as a public line and communication is performedbetween these two is called a video telephone mode.

[0175] In the example shown in FIG. 10, the electronic camera 1-A isconnected to the public line 61 through the connecting line 60 and theelectronic camera 1-B is connected to the public line 61 through theconnecting line 62. At this time, respective shooting lenses 3 facetoward the subnormal direction of surface X2 (the direction where theusers exist), and the light image of the respective users which areconverted into an image signal by CCD 20 are mutually transmittedthrough the public line 61 and displayed on the respective LCDs 6.Therefore, the image of the user on the other side can be displayed oneach respective LCD 6 of the electronic cameras 1-A and A-B.

[0176]FIG. 11 shows one example of the information format which istransmitted through the public line 61 between the electronic cameras1-A and 1-B. As shown in this figure, the information which istransmitted through the public line 61 is formed by a header 70 in whichthe information showing the types of information transmitted before andafter is stored, control information 71 to control the electronic camera1 of the other side, image information 72, memo information 73comprising line drawing or the like, and sound information 74. Moreover,depending on the types of information to be transmitted, there are casesthat one or more of control information 71, the image information 72,the memo image information 73, or sound information 74 are not included.

[0177]FIG. 12 is a flowchart explaining one example of processing whichis executed in the electronic cameras 1-A and 1-B. The program shown inthe flowchart is stored in the memory card 24. The present program canbe supplied to the user in a state where it is recorded onto the memorycard 24, or where it is recorded on a CD/ROM which can be copied ontothe memory card 24.

[0178] This processing is performed when the menu key 7A is operated andthe menu screen is displayed. In the following explanation, theelectronic camera 1-A is the sender and the electronic camera 1-B is thereceiver.

[0179] When the processing shown in FIG. 12 is performed, CPU 39determines whether the video telephone mode was selected among theselection items of the menu screen in step S1. As a result, when it isdetermined that an item other than the video telephone mode was selected(NO), the processing is completed (END). When it is determined that thevideo telephone mode was selected (YES), the program proceeds to stepS2.

[0180] In step S2, CPU 39 refers to the output of potentiometer 56 (seeFIG. 6) and determines whether the rotating part 19 faces toward theuser (whether the shooting lens 3 faces toward the subnormal directionof the surface X2). As a determination standard of this case, as shownin FIG. 5(C), when the optical axis of the shooting lens 3 is within thearea of ±30° of the subnormal direction of the surface X2, it isdetermined that the rotating part 19 faces the user (YES), and therotating part 19 does not face toward the user in cases other than theabove.

[0181] In step S2, when it is determined that the rotating part 19 doesnot face toward the user (NO), the program proceeds to step S3, and amessage encouraging the user to face the rotating part 19 toward theuser. For example, “please face the rotating part toward yourself” isdisplayed on LCD 6, and the program returns to step S2 and the sameprocessing is repeated until the rotating part 19 faces toward the user.Furthermore, in step S2, when it is determined that the rotating part 19faces toward the user (YES) the program proceeds to step S4.

[0182] In step 4, the CPU 39 displays the numerical keys 80-91 on LCD 6,as shown in FIG. 13, and the telephone number of the other side is inputby the user. Furthermore, in this display example, a window display 79displaying the telephone number which was input by the numerical keys80-91 is displayed at the top of the screen and the input telephonenumber can be confirmed. When the telephone number is input and theexecuting key 7B is pressed, the program proceeds to step S5.

[0183] In step S5, the CPU 39 outputs, for example, a tone signalcorresponding to an input telephone number to the public line 61 bycontrolling the modem 57. As a result, a communication line is connectedbetween the other side (receiver) and the sender. In the following stepS6, the CPU 39 begins the transmission of data between the other sideand the sender. That is, the image of the user A which was shot by theelectronic camera 1-A as shown in FIG. 10 is transmitted through thepublic line 61 and is displayed on the LCD 6 of the electronic camera1-B. As a result, on the electronic camera 1-B, the image is displayedas shown in FIG. 14.

[0184] In the following step S7, CPU 39 receives the data which was sentby the other side by controlling the modem 57. As a result, the image ofthe user B which was shot by the electronic 1-B is transmitted throughthe public line 61 and is displayed by LCD 6 of the electronic camera1-A. FIG. 15 shows a display example of the image (the image of user B)which is displayed on LCD 6 of the electronic camera 1-A.

[0185] Furthermore, the resolution of the image of the objects which aremutually transmitted at this time is, for example, approximately 280×220pixels, and is set lower than the resolution of CCD 20 (for example,640×480 pixels). The image data like this is compressed and transmittedbased upon, for example, the MPEG method.

[0186] In step S8, CPU 39 determines whether any of the touch tablet 6A,the control keys 7, the release switch 10 or the recording switch 12,which are the controlling members, is operated. As a result, if it isdetermined that any of these were operated (YES), the program proceedsto step S9. Furthermore, if it is determined that none of them isoperated (NO), the program skips step S9 and proceeds to step S110.

[0187] In step S9, the processing 1 is performed. Furthermore, thisprocessing 1 is a subroutine processing, and the details are discussedlater with reference to FIG. 16.

[0188] In step S10, when the control information 71 is included in thedata (the data which was transmitted by the other side) which wasreceived by the modem 57, the CPU 39 extracts it.

[0189] In step S11, the CPU 39 determines whether the controlinformation 71 is obtained from the data which was received. As aresult, when it is determined that the control information 71 isobtained from the received data (YES), the program proceeds to step S12.Furthermore, if it is determined that the control information 71 is notobtained (NO), the program skips step S12 and proceeds to step S13.Furthermore, the processing of step S12 is a subroutine, and detailswill be discussed later with reference to FIG. 18.

[0190] In step S13, the CPU 39 determines whether an operation tocomplete the video telephone mode was operated. For example, when thecancel 7D is pressed, the CPU 39 determines that the operation tocomplete the video telephone mode was operated (YES), and the programproceeds to step S14. In addition, when it is determined that the cancel7D is not pressed (NO), the program returns to step S8, and the sameprocessing is repeated as described earlier.

[0191] In step S14, the CPU 39 performs processing to disconnect acommunication line and the program proceeds to step S15. In step S15,the CPU 39 begins the electronic viewfinder operation in which the imagewhich was input from the CCD 20 is displayed on the LCD 6, and theprocessing is completed (END).

[0192] According to the above processing, on the menu screen, when thevideo telephone mode is selected, it is determined whether the rotatingpart 19 faces toward the user. When the rotating part faces toward theuser, the communication line between the user and the sender isconnected and the data communication begins. When the data communicationbegins, it determines whether an operating member is operated, andwhether control information is transmitted by the other side. As aresult, when it is determined that an operating member is operated, aresponsive processing is performed, and when it is determined thatcontrol information is transmitted by the other side, processing isperformed responsive to the control information.

[0193] Next, by referring to the flow chart shown in FIG. 16, thedetails of the processing 1 as shown in FIG. 12 are explained. When thisprocessing is performed (called), in step S30, the CPU 39 determineswhether the rotating part 19 was rotated outside of a specified areafrom within the specified area (for example, within the area where theoptical axis of the shooting lens 3 is within ±30° of the subnormaldirection of the surface X2), rotated in the specified area from outsideof the specified area, or any other cases (for example, the case whenthe rotating part is not rotated). As a result, if it is determined thatthe rotating part 19 is rotated outside of the specified area fromwithin the specified area (1), the program proceeds to step S31.Furthermore, if it is determined that the rotating part 19 was moved towithin the specified area from outside of the specified area (2), theprogram proceeds to step S34. In addition, if it is determined that itis none of the above (3), the program proceeds to step S37.

[0194] In step S30, if it is determined that the rotating part 19 wasrotated to outside of the specified area from within the specified area(1), the program proceeds to step S31, and the CPU 39 begins theoperation in which the image which was input from the CCD 20 isdisplayed on LCD 6. Then, the program proceeds to step S32, and the CPUtransmits the image information which was input from the CCD 20 of thesender's side (self) to the receiving side through the modem 57, andcontrol information is transmitted so as to instruct the receiving sideto display the image information which was transmitted. Furthermore, instep S33, the value 1 is substituted for the variable d showing thestate of the rotating part 19, and the program proceeds to step S37.

[0195] In addition, in step S30, if it is determined that the rotatingpart 19 was rotated to within the specified area from outside of thespecified area (2), the program proceeds to step S34, and the CPU 39receives an image that was input in the CCD 20 of the sending side andtransmitted through the public line 61 via the modem 57. Furthermore,the program proceeds to step S35, and after the operation of displayingthe transmitted image on the LCD 6 begins, the program proceeds to stepS36, and the value 2 is substituted for the variable d showing the stateof the rotating part 19, and the program proceeds to step S37.

[0196] Furthermore, if the processing 1 is called first, the value 1 issubstituted for the variable d as an initial value (as a result of theprocessing of step S2 of FIG. 12, the rotating part 19 always facestoward the user).

[0197] In addition, in step S30, when it is determined that this is anyother case (for example, the rotating part 19 is not rotated), theprogram proceeds to step S37.

[0198] In step S37, the CPU 39 determines whether the release switch 10was pressed. As a result, if it is determined that release switch 10 wasnot pressed (NO), the program proceeds to step S41. Furthermore, if itis determined that the release switch 10 was pressed (YES), the programproceeds to step S38.

[0199] In step S38, the CPU 39 determines whether the value of thevariable d is 1 or 2. As a result, if it is determined that the value ofthe variable d is 1 (1), the program proceeds to step S39. Moreover, ifit is determined that the value of the variable d is 2 (2), the programproceeds to step S40.

[0200] In step S39, the image which was input from the CCD 20 is shot(recorded). That is, the light image of the object which was input fromthe CCD 20 is sampled by the image processor 31 and is converted todigital signals by the A/D converting circuit 32. Furthermore, after thecompression processing is performed by DSP 33 based upon the JPEGmethod, it is stored in the shot image storage area of the memory card24. Furthermore, the resolution of the image which is recorded at thistime is, for example, 640×480 pixels and is the same resolution as thecase when ordinary shooting is performed.

[0201] Meanwhile, in step S40, the image which was input from the CCD 20of the receiving side is received and recorded. That is, after it isinput from the CCD 20 of the receiving side and a specified imageprocessing is performed, the image which was transmitted through thepublic line 61 is received by the modem 57 and is recorded to the shotimage recording area of the memory card 24. Furthermore, the resolutionof the image which is recorded at this time is 640×480 pixels, just likethe previous case, and is the same resolution as the case when ordinaryshooting is performed.

[0202] For example, if the rotating part 19 faces toward the oppositedirection from the user (outside of the specified area), in step S30, itbranches into step S31, and the image which was input from the CCD 20 ofthe sender (self) is displayed on the LCD 6 of the sender, and the imageinput from the CCD 20 is transmitted to the receiver in step S32. As aresult, the same image as the sender (the image which was input from theCCD 20 of the sender) is displayed on the LCD 6 of the receiver, and thevalue 1 is substituted for the variable d. The program proceeds to stepS37.

[0203] In step S37, if it is determined that the release switch 10 waspressed (YES), because d=1 is established, it branches into step S39from the following step S38, and the image which was input from the CCD20 of the sender is recorded into the shot image recording area of thememory card 24.

[0204] After that, when the rotating part 19 faces toward the user(within the specified area), in step S30, it branches into step S34, andthe image which was transmitted from the receiver is received and isdisplayed on LCD 6, and the value 2 is stored into the variable d.

[0205] In this state, when the release switch 10 is operated, YES isdetermined in step S37, the program proceeds to step S38, and itbranches into step S40 because d=2 is established. Furthermore, in stepS40, the image which was transmitted by being input from the CCD 20 ofthe receiver is recorded into the shot image recording area of thememory card 24.

[0206] Thus, regardless of whether the image is from the sender orreceiver, when the release switch 10 is pressed, the image which isdisplayed on the LCD 6 is recorded onto the memory card 24. Furthermore,as described earlier, the resolution of the image which is mutuallytransmitted in the video telephone mode is controlled to approximately280×220 pixels, but if the release switch 10 is operated, an image whichis formed by 640×480 pixels is transmitted and recorded.

[0207] In addition, if shooting is performed by either the sender orreceiver, the image which was shot is displayed on the LCD 6 of both thesender and receiver, and a memo image (line drawing) can be written ontothe shot image which is displayed by a method which will be discussedlater.

[0208] That is, in step S41, the CPU 39 determines whether the peninputting was performed by referring to the output of the touch tablet6A. As a result, if it is determined that pen inputting was notperformed (NO), the program returns to step S10 of FIG. 12. Furthermore,if it is determined that pen inputting was performed (YES), the programproceeds to step S42.

[0209] In step S42, the CPU 39 displays the pen inputting screen (forexample, a screen with a blue background) on LCD 6. Furthermore, theprogram proceeds to step S43, and the CPU 39 transmits controlinformation which displays the pen inputting screen to the receiver. Asa result, the same pen inputting screen can be displayed on thereceiver.

[0210] In step S44, CPU 39 displays the memo information which was inputby the pen 41 by the sender on the LCD 6. FIG. 17 is a figure showingthe display of a memo image (line drawing) which was input by the pen 41on LCD 6, as a result of the processing of step S44 (or step S46). Inthis display example, a circuit using a calculation amplifier is inputas a drawing, and if the pen 41 moves on the touch tablet 6A, acorresponding line or curve is displayed on LCD 6. At that time, theinformation which was input by the touch tablet 6A is stored in thebuffer memory 36 as coordinate information, and in response to thiscoordinate information, CPU 39 writes corresponding bit map datacorresponding to the frame memory 35. Thus, the coordinate informationwhich was stored in the buffer memory 36 can be deleted when the cancelkey 7D is pressed as discussed later.

[0211] When the processing of step S44 is completed, the programproceeds to step S45. The CPU 39 transmits the memo image which wasinput to the receiver through the modem 57.

[0212] In step S46, the CPU 39 makes the modem 57 receive the memoinformation which was input by the pen 41 from the receiver, makes theimage which was received superposed upon the data which was stored inthe frame memory 35, converts it into the coordinate information andstores it in the buffer memory 36. As a result, the memo image which wasinput by the sender and the memo image which was input by the receiverwill be superposed and displayed on the LCD 6. That is, as shown in FIG.17, if inputting is performed by the pen 41 on the touch tablet 6A ofthe receiver, a cursor 100 is displayed at the position corresponding toLCD 6 of the sender, and a locus of the cursor 100 is displayed by aline or curve. Furthermore, a position of the pen 41 on the sender isdisplayed by the cursor in the receiver, and a line or curvecorresponding to the locus of the pen 41 of the receiver is drawn.

[0213] In step S47, the CPU 39 determines whether the cancel key 7D orthe change key 92 as shown in FIG. 17 is operated by either the senderor receiver. As a result, if it is determined that both the cancel key7D and the change key 92 are not operated, the program returns to stepS44 and the same processing is repeated as described earlier.Furthermore, if it is determined that the cancel key 7D or the changekey 92 is operated (YES), the program proceeds to step S48.

[0214] Therefore, if the cancel key 7D or the change key 92 is operatedby either the sender or receiver, proceed to the processing of step S48.

[0215] In step S48, the CPU 39 erases the image which is displayed onLCD 6 by clearing the bit map information which is written in the framememory 35, and clears the coordinate information which is written in thebuffer memory 36. Therefore, if the cancel key 7D or the change key 92is operated by either the sender or the receiver, both memo images ofthe electronic camera 1 will be erased. Then, the program proceeds tostep S51.

[0216] Furthermore, as described earlier, when the pen inputting screenis displayed, if the cancel key 7D or the change key 92 is operated,both the frame memory 35 and the buffer memory 36 are cleared, and thememo information which was input by the pen 41 is all deleted. However,for example, during the memo inputting screen display, if the menu key7A is operated and the menu screen is displayed, the bit map informationof the frame memory 35 is updated, but the coordinate information whichis stored in the buffer memory 36 is not cleared so that the memo imagewhich was previously input is displayed again if the memo inputtingscreen is displayed.

[0217] Moreover, after a specified drawing is input in the pen inputtingscreen, if the screen display is changed (for example, when the menuscreen is displayed as discussed earlier), it is also acceptable toprovide two modes, a mode that clears the content of the buffer memory36 and a mode that does not clear the content, and to appropriatelyselect one of them.

[0218] Meanwhile, in step S47, if it is determined that the cancel key7D and the change key 92 are not operated (NO), the program proceeds tostep S49, and it determines whether the executing key 7B was operated byeither the sender or the receiver. As a result, if it is determined thatthe executing key 7B was not operated (NO), the program returns to stepS44 and the same processing is repeated as discussed earlier. Inaddition, if it is determined that the executed key 7B was operated(YES), the program proceeds to step S50.

[0219] In step S50, after adding specified header information to thecoordinate information (the coordinate information corresponding to thememo image which is displayed on LCD 6) which is stored in the buffermemory 35, it is stored in the line drawing information recording areaof the memory card, and the program proceeds to step S51.

[0220] In step S51, the image which was displayed prior to the peninputting is displayed on LCD 6 again, and the program returns to theprocessing of step S10 of FIG. 12.

[0221] Incidentally, in order to confirm what is displayed on LCD 6 ofthe other side, a small window may be displayed on part of the screen,and the same image may be displayed as is displayed on the LCD 6 of theother side. Furthermore, it is also acceptable to erase this window whenthe images which are displayed on the LCDs 6 are the same.

[0222] In addition, it is also acceptable to reduce the image which isdisplayed on the LCD 6 of the other side, display this reduced image onthe screen, and then, by pressing this reduced image (hereafter referredto as the reduction image) by the pen 41, to display the reduction imageby enlarging it as much as possible on the screen, and to display theimage which is displayed on the LCD 6 at that time as a reduction image.In that case, in order to distinguish the window between the other sideand self, for example, it is also acceptable to display a message suchas “the screen which is displayed to the other side” on the window ofthe other side. By setting a structure like that, for example, when awindow showing the image of the other side which is displayed byreduction is enlarged and displayed, it is possible to prevent mistakingthe window between the other side and self.

[0223] According to the above processing, when the rotating part 19faces toward the user, that is, when the image of the other side isdisplayed on LCD 6, if the release button 10 is pressed, an image (theimage of 640×480 pixels) with high accuracy corresponding to the imageof the other side which is displayed on the LCD 6 of the other side istransmitted and recorded onto the memory card 24. Furthermore, if onerotating part 19 faces toward the side opposite to the user, forexample, if the rotating part 19 of the sender faces the side oppositeto the user and the image which was input by the CCD 20 of the sender isdisplayed on the LCDs 6 of both the sender and receiver, when therelease button 10 is operated, an image with high accuracy correspondingto the image which was input by the CCD 20 of the sender, which isdisplayed on the LCD 6, is recorded onto the memory card 24 of the sidewhere the release button 10 was operated.

[0224] Furthermore, if the pen inputting is performed by either thesender or the receiver, the pen inputting screen is displayed on bothLCDs 6. Furthermore, the memo images which are input, by the sender andreceiver, are superposed and displayed so the users feel as if they werewriting on one sheet of a memo image.

[0225] In addition, the memo image which was thus created can berecorded into the line drawing information recording area of the memorycard 24 by operating the executing key 7B. Furthermore, the memo imagewhich is stored this time is the image which was created by superposingthe images which were input by both and the receiver.

[0226] Next, by referring to FIG. 18, details of the processing 2 areexplained.

[0227] When the processing is performed, in step S60, the CPU 39determines whether the modem 57 received the control information (theinformation which was transmitted in the processing of the step S32 bythe electronic camera 1-B of the receiver) that causes the image whichwas input from the CCD 20 to be displayed. As a result, if it isdetermined that the above-mentioned control information was not received(NO), the program proceeds to step S62. If it is determined that theabove-mentioned control information was received (YES), the programproceeds to step S61.

[0228] In step S61, CPU 39 displays the image which was transmitted bythe receiver and received by the modem on LCD 6, and the programproceeds to step S62.

[0229] In step S62, the CPU 39 determines whether the controlinformation (the information which was transmitted in the processing ofstep S43 by the electronic camera 1-B of the receiver) which causes thepen inputting screen to be displayed was received. As a result, if it isdetermined that the above-mentioned control information was not received(NO), the program returns to step S13 of FIG. 12. If it is determinedthat the above-mentioned control information was received (YES), theprogram proceeds to step S63.

[0230] In step S63, the pen inputting screen is displayed on LCD 6. Thatis, the CPU 39 displays the pen inputting screen with a blue backgroundon LCD 6. Furthermore, in the following step S64, the CPU 39 receivesthe memo image which was input by the receiver and displays it on LCD 6.

[0231] In the following step S65, the CPU 39 receives the memo imagewhich was input by the sender (self) by referring to the output of thetouch tablet 6A, and this is displayed on LCD 6. In step S66, the memoimage which was obtained in step S65 is transmitted to the receiverthrough the modem 57.

[0232] In step S67, the CPU 39 determines whether the cancel key 7D orthe change key 92 was operated by either the sender or the receiver. Asa result, if it is determined that the cancel key 7D or the change key92 was operated (YES), the program proceeds to step S68, the data whichis stored in the frame memory 35 and the buffer memory 36 is cleared,the image which is displayed on the LCD 6 is erased, a control signal issent to the receiver, and the content of the frame memory 35 and buffermemory 36 of the receiver is cleared. Then, the program proceeds to stepS71. In addition, if it is determined that neither of the cancel key 7Dand the change key 92 were operated (NO), the program proceeds to stepS69.

[0233] In step S69, the CPU 39 determines whether the executing key 7Bwas operated. As a result, if it is determined that the executing key 7Bwas not operated (NO), the program returns to step S65 and the sameprocessing is repeated as described earlier. Moreover, if it isdetermined that the executing key 7B was operated (YES), the programproceeds to step S70.

[0234] In step S70, after the CPU 39 adds the coordinate information(the coordinate information corresponding to the image where the memoimages which were input by both sender and receiver was superposed)which is stored in the buffer memory 36 to the header, it is recorded tothe line drawing information recording area of the memory card 24.Furthermore, the program proceeds to step S71, the CPU 39 begins theoperation of displaying the image which was input by the CCD 20 of theother side (in this case, the receiver) on LCD 6, and the processing iscompleted (END).

[0235] According to the above processing, in response to a controlsignal which is transmitted by the receiver, it is possible to move tothe video telephone mode and the pen inputting mode.

[0236] Next, by referring to FIG. 19, one example of processing which isperformed in the receiver side electronic camera 1-B is explained. Theprogram shown in this flow chart is stored on the memory card 24 justlike the previous case. Moreover, it is acceptable to supply thisprogram to the user in a state where it is stored in the memory card 24on a CD-ROM (compact disk-ROM) or the like and it is also acceptable tosupply it in a state where it is stored and can be copied to the memorycard 24.

[0237] When this processing is performed, the CPU 39 in step S72determines whether the video telephone mode was selected on the displaymenu screen by operating the menu key 7A. As a result, if it isdetermined that the video telephone mode was not selected (NO), theprocessing is completed (END). In addition, if it is determined that thevideo telephone mode was selected (YES), the program proceeds to stepS73.

[0238] In step S73, CPU 39 determines whether the rotating part 19 facestoward the user. As a result, if it is determined that the rotating part19 does not face toward the user (NO), the program proceeds to step S74.For example, a message stating “please face the rotating part towardyourself” is displayed on LCD 6, the program returns to step S73, andthe same processing is repeated until the rotating part 19 faces towardthe user. Furthermore, if it is determined that the rotating part 19faces toward the user (YES), the program proceeds to step S75.

[0239] In step S75, it is determined whether a communication line isconnected between the user and the other side. That is, CPU 93determines whether a calling is performed by the sender and thecommunication line is connected. As a result, if it is determined thatthe line is not connected (NO), the program returns to step S75, and thesame processing is repeated until the communication line is connected.Furthermore, if it is determined that the communication line isconnected (YES), the program proceeds to step S76.

[0240] In step S76, the CPU 39 controls the modem 57 and begins aprocess of receiving data. As a result, the image which was input fromthe CCD 20 of the sender is received by the modem 57 of the receiver andthe operation of displaying it on LCD 6 begins. In the following stepS77, the data sending processing by the modem 57 of the receiver begins.As a result, the image which was input by the CCD 20 of the receiver istransmitted by the modem 57 and is displayed on the LCD 6 of the sender.

[0241] In step S78, the CPU 39 determines whether an operating memberwas operated (the touch tablet 6A, the operating key 7, the releaseswitch 10, or the recording switch 12). As a result, if it is determinedthat an operating member is not operated (NO), the program proceeds tostep S80. Furthermore, if it is determined that an operating member isnot operated (YES), the program proceeds to step S79.

[0242] In step S79, the processing 1 is performed. This processing isthe same as the processing shown in FIG. 16, so the explanation isomitted

[0243] In the following step S80, if control information is included inthe receiving data, CPU 39 extracts this information. Then, the programproceeds to step S81, and it is determined whether CPU 39 received thecontrol information. As a result, if it is determined that the controlinformation is not obtained, the program proceeds to step S83.Furthermore, if it is determined that the control information wasreceived (YES), the program proceeds to step S82.

[0244] In step S82, the processing 2 is performed. The processing 2 isthe same processing as shown in FIG. 18, so the explanation is omitted.When the processing of step S100 is completed, the program proceeds tostep S83.

[0245] In step S83, CPU 39 determines whether a specified operationwhich completes the video telephone mode is performed. For example, ifit is determined that the cancel key 7D is not pressed (NO), the programreturns to step S78, and the same processing is repeated as describedearlier. Furthermore, if the cancel key 7D is pressed, the CPU 39determines that the operation which completes the video telephone modewas performed (YES), and the program proceeds to step S84.

[0246] In step S84, a line cutting processing is performed, and thecommunication line between the sender and receiver is cut off. Moreover,in step S85, the image which was input by the CCD 20 is selected as theimage to be displayed on LCD 6 (the electronic viewfinder operationbegins). Then, the processing is completed (END).

[0247] According to the above processing, it is possible to connect acommunication line between the sender and the receiver and communicatebetween the sender and the receiver.

[0248] In addition, the present invention is not limited to theelectronic camera of the above embodiment. Needless to say, it is alsoapplicable, for example, to a portable telephone or the like.

[0249] Moreover, in the above embodiment, an image input by the CCD 20is compressed based upon the JPEG standard, and transmitted through thecommunication line 61. Needless to say, for example, it is alsoacceptable to compress, based upon the MPEG standard, transmit, andperform corresponding decompression processing by the sender.

[0250] According to the information processing device and informationprocessing method, if it is detected that a communication line isconnected between another information processing device, an image thatis input in the other information processing device and transmittedthrough the communication line is received and is output to the displaydevice. If it is not detected that a communication line is connectedbetween another information processing device, since a control programis recorded that outputs the image created in the information processingdevice to the display device, it is possible to automatically move tothe video telephone mode when the line is connected.

[0251]FIG. 20 shows an exemplary representation of an electronic cameraconnected to other information processing devices via a network. In thisexample, the electronic camera 1 is connected to network 103. A server105, a telephone 106, a facsimile 107, and a video telephone 108 arealso connected to the network 103.

[0252] The server 105, as shown in FIG. 21, for example, recordsinformation that is supplied to the various information processingdevices via the network 103 in a recording part 112 thereof. Acommunication part 111 carries out communication with other informationprocessing devices via the network 103. A controller 113 is connected tothe communication part 111 and the recording part 112 via a bus 114, andcontrols each part.

[0253]FIG. 22 shows one example of a format of information transmittedby the electronic camera 1 via the network (communication line) 103. Asshown in this figure, the information that is to be transmitted via thenetwork 103 is a header 70 that stores information showing the type ofinformation that will be transmitted directly thereafter and identifyinginformation whether the information processing device, which created theinformation, is an electronic camera, a video telephone, a facsimilemachine, a server or the like. The transmitted information also includescontrol information 71 for controlling the information processing deviceof the communicating parties, image information 72, memo imageinformation including a line drawing or the like, and sound information74. Moreover, depending on the type of the transmitted information, thecontrol information 71, the image information 72, the memo imageinformation 73 and/or the sound information 74 may not be included.

[0254] Next, with reference to the flow charts of FIGS. 23-26, a processwill be described in which the electronic camera 1 connects with theserver 105, the telephone 106, the facsimile machine 107, and/or thevideo telephone 108 via the network 103 and sends and receivesinformation.

[0255] First, in step S101, the CPU 39 determines whether a receivingmode is currently set. When the receiving mode is not set, the programproceeds to step S102, where it is determined whether the transmittingmode is set. If the transmitting mode is not set, the program returns tostep S101, and thereafter repeats the processing of steps S102 and S101.

[0256] In step S102, when it is determined that the transmitting mode isset, the program proceeds to step S103, where the user calls theinformation processing device of the party with whom information will besent and/or received. In the instant case, the user inputs the telephonenumber of the information processing device of the party to be connectedfrom the touch tablet 6A by operating the pen 41 (FIGS. 13,17). In otherwords, the user inputs the telephone number of the server 105, thetelephone 106, the facsimile machine 107, or the video telephone 108.The CPU 39 controls the modem 57 and calls the input telephone number.

[0257] Next, in step S104, the connection with the other party isawaited. When the connection with the other party is made, the programproceeds to step S105, where it is determined whether or not identifyinginformation has been received form the information processing device ofthe other party. In other words, when, instead of the ordinary telephone106 in FIG. 20, a server 105, facsimile machine 107, or video telephone108 is connected to another information processing device, identifyinginformation is transmitted for identifying itself to the otherinformation processing device. In step S105, it is determined whetherthis identifying information has been received.

[0258] In step S105, if it is determined that identifying informationhas not been received from the other party, it is determined that theinformation processing device connected in step S104 is an ordinarytelephone 106. In this case, the program proceeds to step S106, and theCPU 39 carries out a telephone mark display process. In other words, atthis point the CPU 39 displays an image of a telephone mark, such asshown in FIG. 27, along with a message such as “connecting party doesnot have video telephone capability. This will be a sound-onlycommunication.” Therefore, the user can know that the informationprocessing device of the connected party cannot transmit imageinformation or line drawing information. Next, the program proceeds tostep S107, and the CPU 39 turns off the LCD 6. Furthermore, in stepS108, sound signal transmission processing is carried out. In otherwords, the user can use the microphone 8 and speaker 5 and carry on aconversation with the telephone 106 of the other party.

[0259] In step S109, it is determined whether or not the conversationhas ended. If the conversation has not ended, the program returns tostep S108 and repeats the processing of step S108. Thereafter, if it isdetermined in step S109 that the conversation has ended, the programproceeds to step S110, where a communication end procedure is carriedout.

[0260] On the other hand, if it is determined in step S105 thatidentifying information has been received from the informationprocessing device of the other party, the program jumps to step S111.The CPU 39 reads out identifying information that is pre-stored in aROM, which is not shown, and transmits this identifying information tothe other party via the modem 57. Therefore, it becomes possible toperform the same processing in the information processing device of theother party as in the electronic camera 1. For example, when anelectronic camera with the same functions as the electronic camera 1 isconnected to the network 103, the same processing can be performed inthat electronic camera as well.

[0261] Next, the program proceeds to step S112, where it is determinedwhether the identifying information received from the other partyindicates that the information processing device of the other party is avideo telephone. If the information processing device of the other partyis the video telephone 108, the program proceeds to step S113, and theCPU 39 determines whether the device of the other party can pen inputline drawing information. If the other party's video telephone 108 doesnot have a line drawing information inputting function, the programproceeds to step S114, and the CPU 39 sets the superimposing mode thatsuperimposes image information input from the CCD 20 with line drawinginformation input from the touch tablet 6A. When it is determined thatthe other party's video telephone 108 has a line drawing informationinputting function, the processing of step S114 is skipped. In otherwords, the superimposing mode is not set.

[0262] Next, the program proceeds to step S115, and image information,sound information or line drawing information is received from the otherparty's video telephone 108. Then, in step S116, it is determinedwhether image information has been received. If image information hasbeen received, the program proceeds to step S117 and carries out aprocess that displays the received image information. In other words, inthis case, the image information that has been transmitted from thevideo telephone 108 is displayed on the LCD 6 via the frame memory 35.Thus, an image of the user who is using the video telephone 108, such asthe image shown in FIG. 28, is displayed on the LCD 6.

[0263] In contrast, if it is determined in step S116 that imageinformation has not been received, the program proceeds to step S118,and the CPU 39 carries out a display, such as shown in FIG. 29, forenabling the user to know that there is no image of the other party. Inthe display example of FIG. 29, a symbol with an X over a square thatrepresents an image, and the message “there is no image from theconnecting party” are displayed Thus, the user will not mistakenly thinkthat the device is broken because there is no image displayed on the LCD6.

[0264] Next, the program proceeds to step S119, where it is determinedwhether the superimposed mode is set. As described above, when the videotelephone 108 of the other party does not have a line image inputfunction, the superimposed mode is set in step S114. In this case, theprogram proceeds to step S121, and the CPU 39 causes line drawinginformation from the touch tablet of 6A input by the pen 41 to besuperimposed by the DSP 33 on the image of the user input from the CCD20. Then, in step S122, the image information superimposed in step S121and sound information input in through the microphone 8 are transmittedto the video telephone 108 of the other party. In contrast, if it isdetermined in step S119 that the superimposing mode is not set, theprogram proceeds to step S120, and the CPU 39 executes processing toseparately transmit the image information, line drawing information andsound information. In other words, when the video telephone 108 has aline drawing information input function, the video telephone 108essentially has the same functions as the electronic camera 1.Therefore, in this case, these three types of information aretransmitted separately.

[0265] Next, in step S123, it is determined whether the conversation hasended. If the conversation has not ended, the program returns to stepS115 and repeats the processing of step S115. Thereafter, if it isdetermined in step S 123 that the conversation has ended, the programproceeds to step S124 and carries out a communication end procedure.

[0266] In step S112, when it is determined that the informationprocessing device of the other party is the video telephone 108, theabove processing is executed. However, if it is determined in step S112that the information processing device of the other party is not a videotelephone 108, the program jumps to step S125 and determines whether theinformation processing device of the other party is a facsimile machine.This determination is also based on the identifying information. If itis determined that the information processing device of the other partyis the facsimile machine 107, the program proceeds to step S126, and theCPU 39 controls the DSP 33 to read out information that has beenpre-loaded and stored on the memory card 24, and causes this informationto be displayed on the LCD 6. Then, in step S127, it is determinedwhether the image that is now displayed on the LCD 6 is a line drawing.

[0267] If image is not a line drawing (i.e., if it is an ordinaryimage), the program proceeds to step S128 and causes the DSP 33 toperform dither processing in order to make it into an image that showsthe density by the number of pixel points. When it is determined in stepS127 that the image displayed on the LCD 6 (the transmitted information)is line drawing information, the program skips the processing of step S128.

[0268] Next, in step S129 the CPU 39 controls the DSP 33, and when aline drawing exists, superimposes this line drawing on the image. Then,in step S130, the CPU 39 causes the image information (when line drawinginformation exists, it is superimposed) to be transmitted to thefacsimile machine 107 via the modem 57.

[0269] Then, in step S131, the communication end procedure is executed.

[0270] Thus, the information that is transmitted to the facsimilemachine 107 is the information that is pre-stored on the memory card 24.

[0271] In step S125, if it is determined that the information processingdevice of the other party is not a facsimile machine, the program jumpsto step S132, and it is determined whether the information processingdevice of the other party is a network server. If the informationprocessing device of the other party is not a network server, theprogram proceeds to step S133, and the CPU 29 causes characters to bedisplayed on the LCD 6, such as “communication error” as shown in FIG.30. In other words, in the case of this processing example, since it isassumed that the information processing device of the other party willbe one of the telephone 106, the facsimile machine 107, the videotelephone 108, and the server 105, it is assumed that there is an errorwhen none of these are present. Then, in step S134, the communicationend processing is carried out.

[0272] In step S132, if it is determined that the information processingof the other party is the server 105, the program proceeds to step S135,and the CPU 39 causes a menu, such as is shown in FIG. 31, to bedisplayed on the LCD 6. In this menu, characters are displayed such that“transmit”, “receive”, “mode set”, or “end” can be selected. In stepS136 through step S139, the program waits until one of the headings“transmit”, “receive”, “mode set”, or “end” has been selected. In stepS139, if it is determined that “end” has been selected by the pen 41,the program proceeds to step S140, and communication end processing isperformed.

[0273] In contrast, if it is determined in step S136 that the characters“transmit” have been selected by the pen 41, the program proceeds tostep S141. The CPU 39 controls the DSP 33, and causes images stored onthe memory card 24 to be read out, and causes thumbnail images to begenerated and displayed on the LCD 6. At this time, the user indicateswhich of the images among the displayed thumbnails are to be transmittedby using the pen 41. When the selection has been carried out, the CPU 39reads out the original image data corresponding to the indicatedthumbnails and stored on the memory card 24 in step S143. In step S144,this image data is transmitted to the server 105.

[0274] The server 105 records the image data that has been thustransmitted from the electronic camera 1 in the recording part 112.Thereafter, when the user finishes photographing with the electroniccamera 1 and returns home, for example, he or she accesses the server105 from a personal computer and can receive the transmission of theimage data recorded in the server 105.

[0275] On the other hand, if it is determined in step S137 that the“receive” characters have been selected, the program proceeds to stepS145, and the CPU 39 receives a menu of the server 105 from the server105 and displays it on the LCD 6. At this point, in step S146, the userselects the information to be received from the server 105. When thisselection has been performed, since the server 105 transmits theselected information, the CPU 39 receives the selected information instep S147. This receipt information is displayed on the LCD 6, and isalso stored on the memory card 24 as needed.

[0276] In step S138, if it is determined that the “mode set” charactershave been selected, the program proceeds to step S148, and a CPU 39causes the mode set menu to be displayed. At this point, in step S149,the user selects the heading to be set from the displayed menu. Whenthis selection has been performed, in step S150, the CPU 39 carries outprocessing to set the mode. Thus, for example, electronic mailtransmission processing can be set on or off.

[0277] On the other hand, if it is determined in step S101, that thereceiving mode is set, the program proceeds to step S151, and the CPU 39reads out the identifying information of the electronic camera 1 from aROM, which is not shown, and transmits this identifying information.Next, in step S152, the CPU 39 determines whether identifyinginformation has been received from the information processing device ofthe other party. If identifying information has not been received, theconnected information processing device is an ordinary telephone 106.Therefore, the program proceeds to step S153 and performs a telephonemark display processing. In other words, as described above, an imagesuch as that shown in FIG. 27 is displayed on the LCD 6. Thereafter, thesame processing as in step S107-S110 of FIG. 23 is carried out in stepS154 through step S155. In other words, the LCD 6 is turned off, a soundsignal is transmitted until it is determined that the conversation hasended, and when the conversation has ended, a communication endprocedure is carried out.

[0278] In step S152, if it is determined that identifying informationhas been received from the information processing device of the otherparty, in step S158, it is determined whether the information processingdevice of the other party is a video telephone 108. If the informationprocessing device of the other party is the video telephone 108, theprocessing of step S159 through step S170 is executed. This processingis the same processing as the processing of step S113 through step S 124in FIG. 23. Therefore, the description thereof is omitted, but imageinformation and voice information is sent to/received from the videotelephone 108. If the video telephone 108 has a function that recordsline drawing information, then image information, line drawinginformation and sound information are separately transmitted, but if thevideo telephone 108 does not have this function, the line drawinginformation is superimposed on the image information and thentransmitted.

[0279] In step S158, if it is determined that the information processingdevice of the other party is not a video telephone 108, the programproceeds to step S171, where it is determined whether the informationprocessing device of the other party is the facsimile machine 107. Ifthe information processing device of the other party is a facsimilemachine, the program proceeds to step S172, and the telephone number ofthe facsimile machine 107 of the other party and a message showing thatimage information is being received from the facsimile machine 107, suchas “a facsimile is being received”, it is displayed on the LCD 6.Therefore, the user can distinguish the facsimile machine 107 of theother party, and can know that information is being received from thefacsimile machine. Then, in step S173, the CPU 39 receives theinformation that is being transmitted from the facsimile 107, causes itto be displayed on the LCD 6, and, as necessary, stores it on the memorycard 24. Then, when the transmission has ended, in step S174, thecommunication end procedure is carried out.

[0280] In step S171, if it is determined that the information processingdevice of the other party is not a facsimile machine, the programproceeds to step S 175, where it is determined whether the informationprocessing device of the other party is a network server. If theinformation processing device of the other party is not a networkserver, error display processing is carried out in step S176, and instep S177 the communication end processing is carried out. Thisprocessing is the same processing as that of step S133 through step S134in FIG. 24.

[0281] In step S175, when it is determined that the informationprocessing device of the other party is a network server, the programproceeds to step S178, and image information, line drawing informationand sound information is received from the network server 105. Then,when the transmission is completed, in step S179, the communication endprocedure is carried out.

[0282] In the above, the electronic camera 1 was directly connected tothe network server 103. However, as shown in FIG. 32, a PHS 101 can beconnected to the electronic camera 1, and the connection may be made tothe network 103 via the nearest local office 102. In this case, as inthe cases described above, it is possible to connect to the server 105,the telephone 106, the facsimile machine 107, or the video telephone 108via the network 103, but it is also possible to connect to another PHS110, and to an electronic camera 111 connected thereto, via anotherlocal office 104.

[0283] Further, the PHS 101 may be integral with the electronic camera1.

[0284] Furthermore, as shown in FIG. 33, the electronic camera 1 mayalso be connected to the network 103 via a personal computer 109.

[0285] In the above-described embodiments, the image input by the CCD 20was compressed based on JPEG standards and transmitted via a network(communication line) but it is obvious that it is also acceptable tocompress based on MPEG standards, for example, and transmit, and toperform a corresponding decompression process on the receiving side.

[0286] Furthermore, it is obvious that the present invention is notlimited to an electronic camera, but is also applicable to, for example,portable telephones and the like.

[0287] Furthermore, a program that performs the above-describedprocessing may be provided to the user recorded on a recording mediumsuch as a magnetic disk, CD ROM, solid state memory or the like, ortransmitted via a communication medium such as a network, satellite orthe like and recorded on a recording medium.

[0288] Referring to a flow chart as shown in FIG. 34, details of theprocessing 1 shown in FIG. 12 are explained. When the processing isexecuted (called), in step S180, CPU 39 determines whether the menu key7A is operated. As a result, when it is determined that the menu key 7Ais not operated (NO), the program proceeds to step S187. Furthermore,when it is determined that the menu key 7A is operated (YES), theprogram proceeds to step S181.

[0289] In step S181, CPU 39 displays the menu screen which has theselection items of, for example, “RECORDING MODE”, “PLAY BACK MODE”,“SLIDE SHOW MODE” and “SET UP MODE”. In step S182, CPU 39 transmitscontrol information that causes the menu screen to be displayed to thereceiver through the modem 57. As a result the same menu screen isdisplayed on the LCD 6 of the receiver as is shown in FIG. 36.

[0290] In the following step S183, CPU 39 determines whether or not aspecified item is selected on the menu screen. As a result, when it isdetermined that a specified item is selected (YES), the program proceedsto step S184. Furthermore, when it is determined that a specified itemis not selected (NO), the program proceeds to step S185.

[0291] In step S184, CPU 39 transmits control information showing that aspecified item is selected to the receiver through the modern 57. Inaddition, in step S 185, it is determined whether the modem 57 receivesthe control information showing that a specified item is selected by thereceiver. As a result, when it is determined that specified controlinformation is not received (NO), the program returns to step S183, andthe same processing is repeated as described earlier. Furthermore, whenit is determined that specified control information is received (YES),the program proceeds to step S186.

[0292] In step S186, processing corresponding to the selected item (orthe item which the received control information indicates) is performedFor example, when the “reproduction mode” is selected by the sender, notonly the electronic camera 1-A but also 1-B moves to the reproductionmode. Moreover, the same operation is performed when the “reproductionmode” is selected by the receiver.

[0293] Further, during the execution of the reproduction mode, when theclear key 7C is operated and the reproduced information is recorded inthe electronic camera 1 which performed the operation, the image beingreproduced is deleted from the memory card 24. Moreover, when theinformation being reproduced is recorded in the electronic camera of theother side, it is also acceptable not to delete the information (ignorethe operation for the cancel key 7C). According to this structure, it ispossible to prevent the other side from accidentally deleting importantinformation.

[0294] In the following step S187, CPU 39 determines whether therotating part 19 is rotated from within a specified area (within thearea where an optical axis of the shooting lens 3 is ±30° to thesubnormal direction of the surface X2) to outside of the specified area,from outside of the specified area to within the specified area, orother than the above cases (for example, when the rotating part is notrotated). As a result, if it is determined that the rotating part 19 isrotated from within the specified area to outside of the specified area(1), the program proceeds to step S188. Furthermore, when it isdetermined that the rotating part 19 is moved from outside of thespecified area to inside of the specified area (2), the program proceedsto step S190. Furthermore, if it is determined that this is other thanthe above case (3), the program proceeds to step S 192.

[0295] In step S187, when it is determined that the rotating part 19 wasrotated from within the specified area to outside of the specified area,the program proceeds to step S188, and CPU 39 displays the image whichwas input from the CCD 20 on LCD 6. Furthermore, the program proceeds tostep S189, and CPU 39 transmits the image information which was inputfrom CCD 20 of the electronic camera 1-A of the sender and controlinformation which causes the image information to be displayed on theelectronic camera 1-B, which is the receiver, through the modem 57.

[0296] Moreover, in step S187, when it is determined that the rotatingpart 19 was rotated from outside of the specified area to within thespecified area (2), the program proceeds to step S190, and CPU 39 makesthe modem 57 receive the image which was transmitted after being inputin the CCD 20 of the receiver. Furthermore, the program proceeds to stepS191, and the received image is displayed on LCD 6.

[0297] Moreover, in step S187, if it is determined that this is otherthan the above cases (for example, when the rotating part 19 is notrotated), the program proceeds to step S182.

[0298] In step S182, CPU 39 determines whether or not pen inputting wasperformed by referring to the output of the touch tablet 6A. As aresult, if it is determined that the pen input was not performed (NO),the program proceeds to step S200 of FIG. 35, and if it is determinedthat the pen input was performed (YES), the program proceeds to stepS193.

[0299] In step S193, CPU 39 displays the pen inputting screen (forexample, a screen with blue background) on LCD 6. Then, the programproceeds to step S194, and CPU 39 transmits control information whichcauses the pen inputting screen to be displayed on the receiver. As aresult, the same pen inputting screen can be displayed by the receiver.

[0300] In step S195, memo information which was input by the pen 41 bythe sender is displayed on the LCD 6. In FIG. 37, as a result of theprocessing of step S195 (or the processing of step S197), the memo image(line drawing) which was input by the pen 41 is displayed on LCD 6. Inthis display example, a circuit with a calculation amplifier was inputas a drawing, and when the pen 41 is moved on the touch tablet 6A, acorresponding line or curve is displayed on the LCD 6. When theprocessing of step S195 is completed, the program proceeds to step S196,and CPU 39 transmits the memo image which was input to the receiverthrough the modem 57.

[0301] In step S197, CPU 39 causes the memo information which was inputby the pen 41 by the receiver to be received by the modem 57, and thereceived image is superposed by the data which is stored in the framememory 35 and is written. As a result, the memo image which was input bythe sender and the memo image which was input by the receiver aresuperposed and displayed on LCD 6. That is, as shown in FIG. 37, whenthe input was performed by the pen 41 on the touch tablet 6A of thereceiver, a cursor 100 is displayed at the corresponding position on theLCD 6 of the sender, and a locus of the cursor 100 is displayed as aline or curve. In addition, the position of the pen 41 by the sender isshown by the cursor 100 on the receiver, and a line or curvecorresponding to the locus of the pen 41 of the receiver is drawn.Therefore, the same image is displayed on the sender and the receiver.

[0302] In step S198, CPU 39 determines whether a specified operationwhich completes pen inputting mode was performed (for example, theoperation of pressing the cancel key 7D). As a result, if it isdetermined that the specified operation which completes the peninputting is not performed (NO), return to step S195, and the sameprocessing is repeated as described earlier. In addition, when it isdetermined that the operation to complete the pen inputting wasperformed (YES), the program proceeds to step S199.

[0303] In step S199, processing to complete the pen inputting isperformed. That is, CPU 39 returns the display screen to the originalscreen (for example, the image which was input in CCD 20 of the receiveris displayed), and control information to complete the pen inputting istransmitted to the other side. Furthermore, the program proceeds to stepS200 of FIG. 35.

[0304] In step S200 of FIG. 35, CPU 39 determines whether the releaseswitch 10 was operated. As a result, when it is determined that therelease switch is not operated (NO), the program returns to the originalprocessing (the processing of step S10 of FIG. 12) (RETURN). Moreover,when it is determined that the release switch 10 was operated (YES), theprogram proceeds to step S201.

[0305] In step S201, the shooting processing is performed, that is, theimage signal of the object which was output by CCD 20 is sampled by theimage processor 31, is digitized by the AD converting circuit 32 and isoutput to DSP 33. DSP 33 compresses the digitized image based upon theJPEG method and it is recorded to the shot image recording area of thememory card 24. Then, the program proceeds to step S202.

[0306] In step S202, CPU 39 transmits control information, which causesthe shot image data to be displayed, to the other side through the modem57.

[0307] In the following step S203, CPU 39 reads the shot image (theimage which was shot in step S201) data from the memory card 24 andtransmits it to the other side through the modem side 57. Then, theprogram returns to the original processing (the processing of step S10of FIG. 12) (RETURN).

[0308] According to the above processing, when the menu key 7A isoperated by either the sender or receiver, the menu screen is displayedon both LCDs 6 and it is possible for both to select an arbitrary itemfrom the menu screen.

[0309] For example, when the menu key 7A is operated by the sender, themenu screen is displayed by both the sender and the receiver.Furthermore, for example, when the reproduction mode is selected by thereceiver, the image which was shot is reproduced by the sender (the sideon which the menu is displayed). In addition, when the menu key 7A ispressed by the receiver, if the reproduction mode is selected, the imagewhich was shot by the receiver is reproduced.

[0310] Furthermore, when the rotating part 19 of the sender is rotatedfrom within a specified area to outside of the specified area (when theshooting lens 3 faces toward the opposite direction of the user), theimage which was input from the CCD 20 of the sender is displayed on theLCDs 6 of both the sender and the receiver. When the rotating part 19 ofthe receiver is operated the same, the image which was input from CCD 20of the receiver is displayed on both LCDs 6. That is, when the rotatingpart 19 faces a different direction from the user, it is assumed thatthe user does not intend to transmit his/her image to the other side,and that another image should be transmitted, so the image which wasinput from CCD 20 can be transmitted to the other side, the same imagecan be displayed on his/her LCD 6, and the display content can beconfirmed.

[0311] Furthermore, in the above state, when either of the rotatingparts 19 is fixed outside of the specified area, when the rotating part19 is returned to within the specified area, the image which was inputfrom the CCD 20 of the other side is received and displayed. That is,when the rotating part 19 is returned to the original position, it isassumed that the user no longer wants to transmit an image other thanhimself/herself (for example, a human image other than the user), andthe image of the user is transmitted to the other side and the image ofthe user of the other side is displayed on the LCD 6 (return to thevideo telephone mode).

[0312] Furthermore, if the release switch 10 is operated by either thesender or the receiver, the shooting processing is performed, the imagewhich was shot as a result is transmitted to the electronic camera 1 ofthe other side, and the shot image is displayed on the LCD 6 of theother side in addition to the side which performed the shooting.

[0313] In other words, if the operation in which a self image isdisplayed (for example, when the rotating part 19 is rotated from withinthe specified area to outside of the specified area or when the releaseswitch 10 is operated) by either the sender or the receiver, a selfimage can be displayed on both sides. By using this type of structure,when either of the users transmits an image other than himself/herselfto the other side, it is possible to confirm the image which is beingtransmitted to the other side.

[0314] Next, by referring to FIGS. 38 and 39, details of the processing2 are explained. When this processing is performed, in step S210, CPU 39determines whether control information which causes the menu screen tobe displayed is received. That is, when the menu key 7A is pressed bythe receiver, as a result, CPU 39 determines whether control informationthat causes the menu screen to be displayed is transmitted through thepublic line 61. As a result, if it is determined that the controlinformation that causes the menu screen to be displayed is nottransmitted (NO), the program proceeds to step S216, and when CPU 39determines that the control information which causes the menu screen tobe displayed is received (YES), the program proceeds to step S211.

[0315] In step S211, CPU 39 displays the menu screen (see FIG. 36) onLCD 6. Then, the program proceeds to step S212 and CPU 39 determineswhether a specified item is selected. As a result, if it is determinedthat a specified item is selected (YES), the program proceeds to stepS213, and if it is determined that a specified item is not selected(NO), the program proceeds to step S214.

[0316] In step S214, CPU 39 determines whether the modem 57 receivescontrol information showing that a specified item was selected. As aresult, if it is determined that the control information showing that aspecified item was selected was not received (NO), return to step S212,and the same processing is repeated as described earlier. Furthermore,when it is determined that the control information showing that aspecified item was selected was received (YES), the program proceeds tostep S215.

[0317] Meanwhile, in step S213, CPU 39 transmits control informationwhich selects the specified item that was obtained in step S212 to thereceiver. Then, the program proceeds to step S215.

[0318] In step S215, processing corresponding to the selected item isperformed. That is, CPU 39 performs processing corresponding to the itemselected by the sender or the item selected by the receiver. Forexample, when the reproduction mode is selected by either side, theimage which was shot by the sender (the side on which the operationdisplaying the menu screen was performed) is reproduced.

[0319] In the following step S216, CPU 39 determines whether the controlinformation (the information which was transmitted in step S39 of FIG.16) which causes the image which was input from CCD 20 to be displayedis received. As a result, if it is determined that the controlinformation which was described earlier is not received (NO), theprogram proceeds to step S218, and when it is determined that thecontrol information which was described earlier is received (YES), theprogram proceeds to step S217.

[0320] In step S217, CPU 39 displays the image data which was receivedfrom the modem 57 on LCD 6. As a result, the image which was input fromthe CCD 20 of the receiver can be displayed on LCD 6.

[0321] In the following step S218, CPU 39 determines whether the controlinformation (the information which was transmitted in the processing ofstep S44 of FIG. 16) that causes the pen inputting screen to bedisplayed has been received. As a result, if it is determined that thecontrol information that causes the pen inputting screen to be displayedis not received (NO), the program proceeds to step S225 of FIG. 39.Furthermore, if it is determined that the control information thatcauses the pen inputting screen to be displayed is received (YES), theprogram proceeds to step S219.

[0322] In step S219, CPU 39 displays the pen inputting screen (forexample, a screen with a blue background) on LCD 6, and the programproceeds to step S220. In step S220, the line drawing (memo image) thatwas received by the modem 57 is displayed on LCD 6 after being input andtransmitted from the touch tablet 6A of the receiver.

[0323] In step S221, CPU 39 superposes and writes the memo image whichwas input from the touch table 6A of the sender over the image which isdisplayed on LCD 6. As a result, the memo image that was input from thetouch tablet 6A of the sender and the memo image that was input from thetouch tablet 6A of the receiver and is transmitted are superposed anddisplayed.

[0324] In step S222, CPU 39 transmits the memo image which was inputfrom the touch tablet 6A of the sender to the receiver through modem 57.As a result, the memo image which was input from the touch tablet 6A ofthe sender is also displayed on the LCD 6 of the receiver.

[0325] In the following step S223, it is determined whether the peninputting is completed. That is, CPU 39 determines whether the operationto complete the pen inputting was performed. As a result, when it isdetermined that the operation to complete the pen inputting is notperformed (NO), the program returns to step S220 and the same processingis repeated as described earlier. Furthermore, if it is determined thatthe operation to complete the pen inputting was performed (YES), theprogram proceeds to step S224.

[0326] In step S224, the processing to complete the pen inputting isperformed. That is, CPU 39 returns the display to the original (forexample, the image which was input from CCD 20 of the other side isdisplayed on LCD 6), and the control information to complete the peninputting is transmitted to the other side. Then, the program proceedsto step S225 of FIG. 39.

[0327] In step S225, CPU 39 determines whether the control informationthat causes a shot image to be displayed is received by referring to theoutput from the modem 57. As a result, if it is determined that thecontrol information that causes the shot image to be displayed is notreceived (NO), the program returns to the original processing (theprocessing of step S13 of FIG. 12) (RETURN). Furthermore, if it isdetermined that the control information that causes the shot image to bedisplayed is received (YES), the program proceeds to step S226. That is,when the release switch 10 is operated by the other side, and thecontrol information (the control information causing the shot image tobe displayed) which is transmitted as a result is received, the programproceeds to step S226.

[0328] In step S226, CPU 39 receives the shot image data which wastransmitted from the other side through the modem 57. Then, the programproceeds to step S227.

[0329] In step S227, after the decompression processing is performed onthe shot image data which was received in step S226, CPU 39 displays iton LCD 6. Then, the program returns to the original processing(processing of step S13 of FIG. 12) (RETURN).

[0330] According to the information processing device and informationprocessing method, if it is detected that a communication line isconnected between another information processing device, when an imagerecording operation is performed, the image which is transmitted by theother information processing device is recorded. If the connection of acommunication line cannot be detected when the image recording operationis performed, the image which was input by the information processingdevice is recorded. Thus, it is possible to automatically select theimage which is shot in response to the connected and disconnected stateof the line.

[0331] According to the above processing, in response to controlinformation transmitted by the receiver, for example, it is possible todisplay the menu screen, perform the pen inputting, and display the shotimage which was shot by the other side.

[0332] An example of the processing which is performed in the electroniccamera 1B, which is the receiver, is the same as described in FIG. 19.

[0333] Additionally, as noted with respect to the seventh embodiment,the recording medium can be, for example, a CD-ROM or a carrier wave.

[0334] In the illustrated embodiments, the controller (CPU 39) isimplemented using a suitably programmed general purpose computer, e.g.,a microprocessor, microcontroller or other processor device (CPU orMPU). It will be appreciated by those skilled in the art, that thecontroller can also be implemented as a single special purposeintegrated circuit (e.g., ASIC) having a main or central processorsection for overall, system-level control, and separate sectionsdedicated to performing various different specific computations,functions and other processes under control of the central processorsection. The controller can also be implemented using a plurality ofseparate dedicated or programmable integrated or other electroniccircuits or devices (e.g., hardwired electronic or logic circuits suchas discrete element circuits, or programmable logic devices such asPLDs, PLAs, PALs or the like). The controller can also be implementedusing a suitably programmed general purpose computer in conjunction withone or more peripheral (e.g., integrated circuit) data and signalprocessing devices. In general, any device or assembly of devices onwhich a finite state machine capable of implementing the flow chartsshown in the figures can be used as the controller.

[0335] While the present invention has been described with reference topreferred embodiments thereof, it is to be understood that the inventionis not limited to the disclosed embodiments or constructions. To thecontrary, the invention is intended to cover various modifications andequivalent arrangements. In addition, while the various elements of thedisclosed invention are shown in various combinations andconfigurations, which are exemplary, other combinations andconfigurations, including more, less or only a single element, are alsowithin the spirit and scope of the invention.

What is claimed is:
 1. An information processing device that connectswith another information processing device through a communication lineand mutually communicates information, comprising: a display device; animage input device that inputs an image of an object; an output devicethat outputs the image to said display device; a transmitter thattransmits information to the other information processing device throughthe communication line; a receiver that receives the information whichwas transmitted from the other information processing device through thecommunication line; and a connection detector that detects that acommunication line is connected between the information processingdevice and the other information processing device; wherein, when saidconnection detector detects that a communication line is connectedbetween the other information processing device, an image is input bythe other information processing device and transmitted through thecommunication line, the image being received by said receiver and outputto said display device by said output device, and when said connectiondetector cannot detect that the communication line is connected betweenthe information processing device and the other information processingdevice, an image which was formed by the information processing deviceis displayed in said display device.
 2. The information processingdevice of claim 1, wherein the information processing device is anelectronic camera.
 3. An information processing method in whichinformation is mutually communicated between first and secondinformation processing devices that are connected through acommunication line, comprising: detecting that a communication linebetween the first and second information processing devices isconnected; receiving an image that is input from the second informationprocessing device and transmitted through the communication line at thefirst information processing device and outputting the image on adisplay device of the first information processing device; andoutputting an image which was formed from the first informationprocessing device to the said display device of the first informationprocessing device when the communication device cannot be detected.
 4. Arecording medium on which is recorded a control program used in aninformation processing device that is connected to another informationtherebetween processing device through a communication line and mutuallycommunicates information therebetween, wherein the control program:detects that a communication line is connected between anotherinformation processing device; receives an image that is input in saidother information processing device and transmitted through saidcommunication line and outputs the image to a display device of theinformation processing device when the communication line is detected;and outputs an image that was formed in said information processingdevice to said display device of the information processing device whenthe communication line is not detected.
 5. An information processingdevice that is connected to another information processing devicethrough a communication line and which mutually communicates informationtherebetween, comprising: an image input device that inputs an image ofan object; a receiver that receives an image that was transmitted fromthe other information processing device through the communication line,a connection detector that detects a communication line connectedbetween the information processing device and the other informationprocessing device; an operating mechanism that is operated when theimage is to be recorded; and a recorder that records the image when theoperating mechanism is operated, wherein the other informationprocessing device transmits the image and said recorder records thereceived image when the connection detector detects connection of thecommunication line and operation of said operating mechanism, and saidrecorder records an image that was input by said image input device. 6.The information processing device of claim 5, wherein the informationprocessing device is an electronic camera.
 7. An information processingmethod in which information is mutually communicated with anotherinformation processing device that is connected through a communicationline, comprising: detecting that a communication line with the otherinformation processing device is connected; recording an image that wastransmitted from said other information processing device when theconnection of a communication line with the other information processingdevice is detected and when an operation to record an image isperformed; and recording an image that was input by the informationprocessing device when the connection of said communication line cannotbe detected and when an operation to record an image is performed.
 8. Arecording medium on which is recorded a control program used in aninformation processing device that is connected to another informationprocessing device through a communication line and mutually communicatesinformation therebetween, wherein the control program: detects that acommunication line is connected between the information processingdevice and the other information processing device; records an imagethat was transmitted from the other information processing device whenconnection of the communication line is detected and when an operationto record an image is performed; and when the connection of thecommunication line cannot be detected and when an operation to record animage is performed, records an image that was input by the informationprocessing device.
 9. An information processing device that transmitsinformation to another information processing device, comprising aninput device that inputs a plurality of information; a recorder thatrecords the information input by the input device; a transmitter thattransmits select information to the other information processing device;a controller that evaluates the other information processing device anddetermines the select information to be transmitted based on the resultof the evaluation.
 10. The information processing apparatus of claim 9,further comprising a switch that switches between a first mode in whichthe information input from the input device is transmitted without beingrecorded in the recorder, and a second mode in which information that isrecorded in the recorder is transmitted.
 11. The information processingdevice of claim 9, wherein the information processing device is anelectronic camera.
 12. The information processing device of claim 9wherein the plurality of information includes at least one of soundinformation, line drawing information, and image information.
 13. Theinformation processing device of claim 9 wherein, when the otherinformation processing device does not have an image informationreceiving function, the selector selects only sound information.
 14. Theinformation processing device of claim 12, further comprisingsuperimposing means for superimposing the line drawing information andthe image information, wherein when the other information processingdevice has an image information recording function but does not have afunction that records the image information and the line drawinginformation independently, the transmitter transmits the line drawinginformation and image information that has been superimposed by thesuperimposing means.
 15. The information processing device of claim 14,further comprising processing means for dither processing the image,wherein when the other information processing device is a facsimilemachine, the transmitter superimposes dither processed image informationover the line drawing information and transmits the superimposedinformation.
 16. The information processing device of claim 9, whereinthe information processing device is an image processing device and thecontroller controls the display in response to evaluation of the otherinformation processing device.
 17. The information processing device ofclaim 16, wherein when image information is not transmitted from theother information processing device when that device has a function thatallows transmission of image information, the controller controls thedisplay to indicate to a user that the image information is not beingtransmitted.
 18. The information processing device of claim 16, whereinwhen information is received from a facsimile machine serving as theother information processing device, the controller causes the displayto display that information is being received from the facsimilemachine.
 19. The information processing device of claim 16, wherein whenthe other information processing device is a server, the controllercauses the display to display a menu.
 20. An information processingmethod for an information processing device that transmits informationto another information processing device, comprising: inputting aplurality of information to the information processing device; recordingthe inputted plurality of information; evaluating the other informationprocessing device; selecting information to be transmitted, based on theresult of the evaluating step; and transmitting the plurality ofinformation to the other information processing device.
 21. Theinformation processing method of claim 20, wherein the plurality ofinformation includes at least one of sound information, line drawinginformation and image information, and the step of selecting informationselects only sound information when the other information processingdevice is evaluated and found not to have an image information receivingfunction.
 22. The information processing method of claim 20, wherein theplurality of information includes at least one of sound information,line drawing information and image formation, and the step of selectinginformation selects superimposed line drawing information and imageinformation when the evaluating step finds that the other informationprocessing device has an image information recording function but doesnot include a function that records line drawing informationindependently.
 23. The information processing method of claim 22,wherein when the other information processing device is evaluated anddetermined to be a facsimile, the selecting step selects transmission ofdither processing image information superimposed over line drawinginformation.
 24. The information processing method of claim 23, furthercomprising the steps of: displaying information relating to theplurality of information; and controlling the display step in responseto the result of the evaluating step.
 25. A recording medium on which isrecorded computer program used in an information processing device thattransmits information to another information processing device, whereinthe control program: inputs a plurality of information to theinformation process device; records the inputted plurality ofinformation; evaluates the other information processing device; selectsinformation to be transmitted, based on the result of the evaluatingstep; and transmits the plurality of information to the otherinformation processing device.
 26. The recording medium of claim 25 onwhich is stored a computer program used in an information processingdevice that transmits information to another image processing device,wherein the computer program further: displays information relating tothe plurality of information; and controls the display in response tothe evaluation.
 27. An information processing device thattransmits/receives information to/from another information processingdevice, comprising: an input device that inputs a plurality ofinformation; a recorder that records the information input by the inputdevice; a display that displays information; a transmitter thattransmits specified information among the plurality of information tothe other information processing device; and a receiver that receivesinformation transmitted from the other information processing device; anevaluator that evaluates the other information processing device; andmode setting means that, in response to the result of the evaluator,sets one of a first mode that causes the display to display informationtransmitted from the other information processing device and a secondmode that causes the display to display information recorded by therecorder.
 28. The information processing device of claim 27, wherein theplurality of information includes at least one of sound information,line drawing information and image information.
 29. The informationprocessing device of claim 27, wherein the information processing deviceis an electronic camera.
 30. The information processing device of claim29, wherein the other information processing device is one of atelephone, videophone, facsimile machine and server.
 31. An informationprocessing method for an information processing device that transmitsand receives information to/from another information processing device,comprising: inputting a plurality of information to the informationprocessing device; recording the plurality of information input in theinput step; displaying information relating to the plurality ofinformation; transmitting specified information from among the pluralityof information to the other information processing device; receivinginformation transmitted from the other information processing device;evaluating the other information processing device; and setting one of afirst mode that causes the information transmitted from the otherinformation processing device to be displayed in the display step and asecond mode that causes information recorded in the recording step to bedisplayed in the display step in response to the result of theevaluating step.
 32. A recording medium on which is recorded a computerprogram used in an information processing device that transmits/receivesinformation to/from another information processing device, wherein thecomputer program: inputs a plurality of information to the informationprocessing device; records the plurality of information input in theinputting step; displays information relating to the plurality ofinformation; transmits specified information from among the plurality ofinformation to the other information processing device; receivesinformation transmitted from the other information processing device;evaluates the other information processing device; and sets one of afirst mode that causes information transmitted from the otherinformation processing device to be displayed in the display step and asecond mode that causes information recorded in the recording step to bedisplayed in the display step in response to the result of theevaluating step.
 33. An information processing device which is connectedwith another information processing device and which mutuallycommunicates information therebetween through a communication line,comprising: an image input device that inputs an image to theinformation processing device; an output device that outputs the imageinput by said image input device and an image that was transmitted fromsaid other information processing device to a display device of saidinformation processing device; a switch that switches between a firstmode, where the image which is displayed on said display device by saidoutput device is different from an image that is displayed on a displaydevice of said other information processing device, and a second modewhere displayed images are the same; and a controller that controls saidswitch in response to a state of said information processing device. 34.The information processing device as set forth in claim 35, wherein saidfirst mode outputs an image that was input from an image input device ofsaid other information processing device and transmitted through thecommunication line to said display device of said information processingdevice by said outputting means of said other information processingdevice and the image which was input by said image input device of saidinformation processing device is transmitted to said other informationprocessing device through said communication line; and said second modeoutputs to the display device one of the image that was input from saidimage input device of said other information processing device and wastransmitted through said communication line and the image that was inputby said image input device of said information processing device. 35.The information processing device as set forth in claim 33, wherein whenline drawing information is input from one of said image input deviceand an image input device of said other information processing deviceand subsequently received by the information processing device, saidcontroller controls said switch to change to said second mode, andoutputs the image of the information processing device that input theinformation by said output device.
 36. The information processing deviceas set forth in claims 33, wherein an image of an object is input bysaid image input device and when a direction of an optical axis of theoptical system of said image input device is changed and detected in oneof the information processing device and said other informationprocessing device, said controller controls said switch to change tosaid second mode and outputs to the display device the image that wasinput from said image input device of the information processing devicewhere the direction of the optical axis was changed.
 37. The informationprocessing device as set forth in claim 33, wherein an image of theobject is input from said image input device and a recorder records theimage input from said image input device, said controller controllingswitching of the switch to said second mode and outputting the imagethat was input from said image input device of the informationprocessing device from which the image was recorded.
 38. The informationprocessing device as set forth in claim 33, further comprising aselector that selects the image that is output from said output device,said controller controlling switching of said switch to the second modeand outputting of the image that was selected in the informationprocessing device to said display device.
 39. A method of controlling aninformation processing device that is connected to another informationprocessing device and mutually communicates information therebetween,comprising the steps of: inputting an image to the informationprocessing device; outputting one of an image that was input and animage that was transmitted from said other information processing deviceto a display device; and switching between a first mode, where the imagewhich is displayed on said display device is different from an imagedisplayed on a display device of said other information processingdevice and a second mode, where both images are the same in response toa state of said information processing device.